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Summary. 1. A brief outline of the evolution of neuron 
Jeling is given and an argument is presented for studying 
ral behavior by “black-box” logical equivalence. 

2. An electronic circuit incorporating many of the digi- 
and analog properties of neurons is described. Having 
h properties as variable threshold, summation, all-or-none 
put, absolute and relative refractoriness, and inhibition, 
xhibits a considerable amount of functional equivalence 
biological structures. 

3. Properties of the model are described in detail and 
vance to biological neuron measurements are shown. Such 
avior as time-intensity trade, repetitive firing and temporal 
umation are readily achieved and are shown to appro- 
ate im vivo behavior. 

4. The model is sufficiently flexible so that with simple 
ameter changes and external circuit configurations, a 
e variety of neurological phenomena can be exhibited 
| studied closely. By adding stimulus-derived inhibition 
example, accommodation and adaptation are obtained. 
5. Experiments with the model have suggested new rela- 
ships which nervous structures may exhibit. A linear 
endence of burst pulse number on accommodation time 
stant, and a summation-division phenomenon are ex- 
ples of such findings. 

6. Models of this sort have utility not only for studying 
le unit properties but also for investigating group inter- 
ions. Such studies may be relevant to elucidation of 
ral network behavior. 


Introduction 


In attempting to understand nervous systems, one 
y ask questions on at least four different levels. 
the subcellular level are studies such as those of 
transport mechanisms and membrane properties. 
ondly, single cells may be studied for their input- 
put functions, the stimulus-response relationships. 
another level, groups of cells are investigated in 
ms of their interactive behavior; this ranges from 
systems such as reflex arcs to neural pools and 
organized mass actions. Finally, there are the 
chophysical investigations of the entire organism 
wed as a “‘black-box’’. 

The research reported here takes for its locus the 
ular input-output functions level, seeking to ex- 
re the “‘logical” properties of the single neuron by 
use of analog models. It is also directed in part 
the third of the foregoing categories, i.e., to an 
estigation of the interactions of small numbers of 
se units. It seeks to explore some of the information 
cesses encoded in neural activity. 

In the past, biological systems have been regarded 
such terms as metabolism, electrical activity, re- 
duction, and movement. It is increasingly apparent 
t in addition, the processing and flow of information 
» relevant property. This is especially true for 
vous systems. The present work is based on the 
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view that the essential role of neural structure is to 
manipulate information; neural events represent the 
language of this process. Such an approach is not 
concerned with detailed electrical, chemical or ionic 
events within a cell, but only with their ultimate 
operational effects. Neural functions can (in principle) 
as readily be specified with electronic circuits or mathe- 
matical symbols as with ion-membrane mechanisms. 
It is essential only to preserve the fundamental logical 
operations. Thus, chemical, electronic and mathe- 
matical systems may all be expressions of identical 
functions and may be used interchangeably as state- 
ments of the same mechanism. 

Modeling of neural properties is not new. Sixty 
years ago HERMANN (1899) considered nervous activity 
in terms of electrical cable behavior. Lini1e (1936) 
described a chemical model of axon conduction which 
was subsequently greatly elaborated by others. A 
large number of mathematical models have appeared 
in the literature, of which those of McCuLtocu & 
Prirrs (1943), Hopaxin & Huxtey (1952b), Minsky 
(1953), KuEENE (1956) and von NeumMANN (1956) are 
representative. Electronic analogs of neural properties 
have been described by Burns (1955), Harmon (1959), 
CRANE (1960) and KiprmMtLuer & JENIK (1961). Com- 
puter simulation studies such as those by RocHEsTER 
(1956), Writs (1959) and Fartey & CuaRK (1960) et al. 
have been directed to investigating neural network 
behavior. 

Electronic analogs of neurons provide a flexible 
means for exploring the logics of the nervous system. 
It is relatively easy to incorporate a large number of 
parameters representative of the biological cell. The 
model may then literally be used as an analog com- 
puter to examine functions that may be exceedingly 
difficult if not impossible to predict or to fully analyze. 
The studies described in this paper take for their 
premise that such simulation can have utility and 
that continued exploration with such models can lead 
to a better comprehension of neural events. 

There has been a sharp increase in neural modeling 
activity during the last few years, and it is important 
to point out that two distinct philosophies are in- 
volved. One school, of which the present work is 
representative, seeks to make its “neurons” simulate 
biological functions as closely as possible. Input-output 
relationships are made to be consistent with what is 
known of the biological parameters. The intent is to 
study the probable information-processing functions 
of neurons and in so doing to elucidate further the 
operations of the biological system. 
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Among the second group of modelers (by far the 
most populous) the idea is to explore the large-scale 
behavior of many quasi-neuron elements arranged in 
randomly connected nets. Inasmuch as the properties 
of these elements are greatly simplified abstractions 
of known neural functions, and the network connec- 
tivity bears no necessary resemblance to biological 
structure, it seems unlikely that results bearing real 
physiological significance will emerge. 

There is reason to confine our present studies to 
peripheral mechanisms. Little enough is known of 
function at the transducer levels and the early relay 
stages; firm knowledge of cortical events is even less 
detailed and secure. The peripheral structures are 
simpler, are better known anatomically and physio- 
logically, and are more accessible to experimentation 
than are the central structures. Furthermore, it would 
appear useful to understand the mechanisms of the 
retina and the optic nerve signal encodings, for ex- 
ample, before attempting to comprehend more central 
events. Certain recent studies (KUFFLER, 1953; HUBEL 
& Wrese, 1959; Lerrvin, Marurana, McCuntocn & 
Prrrs, 1959) illustrate the utility of this view. 


The Model 

Most of the models proposed to date have incor- 
porated the classical axonal properties of temporal 
summation, variable threshold, inhibition, refractory 
recovery and all-or-none output. It has become appar- 
ent, however, that the properties of the entire neuron 
must be simulated. This means that adequate pro- 
vision must also be made for the graded dendritic 
functions having longer time constants and decre- 
mental conduction. 

Although a considerable amount of important 
activity is assignable to these continuous-variable in- 
put functions (as opposed to axonal discrete-variable 
behavior), there is no compelling reason to believe 
that axon action potentials do not represent the prin- 
cipal language of the peripheral nervous system. We 
recognize BuLLock’s (1959) observation that axon 
spikes are not seen in some neural structures and his 
conclusion that they may be incidental and super- 
fluous to function. Nevertheless, if we take as a func- 
tional neural unit the system from dendritic ramifica- 
tions to axonal termini, it is clear that however diffuse, 
graded, and smeared in time the input signals may 
be, the functional output is unique, standardized (to 
a first-order approximation) and is crisply defined. 
All-or-none activity assuredly accounts for more than 
long-distance transmission; for example, the concomi- 
tant refractory phenomena clearly play an important 
role in modifying signals. 

Thus, it is useful to consider that there are two 
kinds of information processing present. In one, the 
intracellular continuous-variable processes are signifi- 
cant. In the other, discrete but variable signals be- 
tween cells operate to transmit and to modify in- 
formation. Both are essential to a complete description 
of neural events. 

The model* we use is electronic, being a circuit of 
five transistors and associated resistors, capacitors and 

+ In a proposal for a systematic nomenclature of devices 
which simulate biological functions, van BrrGErK (1960) 
suggested the term newromime for neuron models. We adopt 


this designation in subsequent references to the artificial 
neuron. 
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diodes. An earlier version was described (HaRMon 
1959) in which the functions were less accurate an 
flexible than they are presently. A detailed circui 
analysis of that version appears in Harmon & WoLr 
(1959). The present version, which retains the basi 
structure of the earlier one, is shown in Fig.1. _ 
Five excitatory inputs are integrated by their as 
sociated 150 KQ resistors and the 0.02 uF capacito 
on the base of the first transistor 7. Depending o1 
how the input (dendritic) leads are connected t 
various (axon or receptor) sources, the integratin, 
time constant can be varied from 0.46 to 1.2 msec 
Threshold is determined by the relationship betweer 
the potential on the base of 7’, (corresponding to th 
time course of input signals) and the potential on th 
emitter of 7', (depending upon the recent firing histor 
of the unit). 7, and 7’, together form a monostabl 
multivibrator whose function is to produce a sing 
pulse if threshold is exceeded. 7’; and 7, form a 
amplifier and low impedance output source such tha 
as many as 100 other units may be driven directh 
if desired. The function of 7’, is to invert an othe 
wise excitatory signal. The inverted signal is summe 
with the five excitatory inputs to produce inhibition 
The refractory function is obtained from the tim 
constant associated with 7, and T,, whose pulse 
emitting activity may be inhibited by a graded chang 
in their virtual threshold. The circuit provides a 
absolute refractory period which is approximatel} 
1.0 msec long (the output pulse duration) and whid 
is immediately followed by a decaying exponentié 
recovery to resting threshold having a time constar 
of 2.7 msec. As will be shown, this and the inpu 
time constant may be readily modified over a wid 
range to simulate a variety of neural mechanisms. 
The neuromime has a transmission delay the 
varies from 0.1 to 1.0 msec depending on input cor 
nections and on firing frequency. Because of th 
nature of the active electronic components, the uni 
permits unidirectional propagation only, i.e., no anti 
dromic stimulation is possible. 
Inhibition is a continuous (graded) and essential 
linear function of the potential applied to the inhib 
tion input. Two quite different kinds of inhibitio 
have been described for biological preparations. I 
one, an inhibitory impulse increases resting membrat 
potential, thereby increasing the threshold for e: 
citatory impulses (BRooK, Coomss, & Eocims 1952 
In the other, inhibitory impulses diminish any loe 
polarization or depolarization which may be presen 
tending to restore resting potential (Farr & Kat 
1953). Thus in the first case inhibition may be views 
as an active potentiating process while in the secor 
it is effectively a passive attenuation. The form 
process is subtractive, the latter multiplicative. 1 
the present design of the neuromime the first proce 
is modeled. 
Any number of excitatory or inhibitory inputs ai 
possible, of course, since multiple inputs can be co 
verged into any combination of the five excitato 
and one inhibitory leads. Each input can have ade 
tional resistive networks appended to obtain deer 
mental conduction, and auxiliary capacitors may | 
added to obtain long time constant, graded dendrit 
behavior. This leads to latencies which act in additic 
to the simple internal delay mentioned above. Dio 
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lation between units can be arranged, if required, 
minimize interference or loading between multiple 
ving units. 

There appears to be some evidence that the trans- 
ssion properties of synapses in the CNS vary with 
> (Ecctes & McIntyre, 1953). Although we have 
veloped models for obtaining variable synaptic im- 
dance, they are not being employed in present 
periments and will not be described here. We do 
t introduce them for two reasons: first, the evidence 
> variable synaptic behavior is incomplete and 
ntroversial; second, peripheral (e.g. retinal) structure 
vy be assumed to be relatively invariant, and there 
ams little necessity at present to invoke synaptic 
anges as functions of experience at this level. 

The primitive functions of the neuromime are sum- 
arized in Table 1. 


Table 1 


Resting threshold 


—1.5 V for steady, transducer-like 
input (rheobase) 

—3.0 V for typical single spike 
input 

Time constant: 0.46 to 1.2 msec, 
depending on input configura- 
tion 


Temporal summation 


Delay 0.1 to 1.0 msec, depending on firing 
frequency and input configura- 
tion 

Spike output 0.8 to 1.2 msec pulse of —10V 
amplitude 


Absolute: ~ 1.0 msec ~ 
Relative: 2.7 msec time constant 
0—600 pulses per second 


Refractoriness 


Firing frequency 


Inhibition Graded subtraction from excita- 
tion 
Power consumption 81 mW 


The magnitudes of the voltages employed in the 
odel do not correspond to biological levels. This is 
»t important, however, because the voltage ratios 
e similar to the natural ratios. For example, the 
7:1 ratio of spike amplitude to rheobase in the model 
proximates the 7:1 safety-factor described for bio- 
gical preparations (HopGKIN 1937, 1948). The tem- 
ral relationships closely approximate those in natural 
surons. While it may be argued that a rectangular 
itput pulse of 1 msec duration having no subnormal 
> supernormal phases is too gross a representation 
‘the spike potential, our feeling is that the discre- 
uncies introduce negligible differences in over-all 
nctional (logical) behavior. Should the discrepan- 
es turn out to be significant, it would be relatively 
sy, as will be shown, to modify the model to provide 
differentiated output or post-output polarizations. 

Several natural neural properties are not incor- 
srated in the model. For one, conduction velocity 
ong input or output leads can be made neither slow 
xr variable. This means that there is no “event’’ 
slay other than two simple types of internal latencies 
hich will be described. However, the neuromime 
wn also be considered as a section of myelinated 
<on rather than as a complete cell. If a number 
units are connected serially, then conduction is 
Itatory; each unit represents a node, while the con- 
sctions between them represent rapidly conducting 
ternodes. In this way, various transmission delays 
ay be achieved. A second omission is that, with the 
<ception of the very rapid dynamic flip-flop action 


of the pulse generator, excitation does not grow after 
removal of a stimulus. Therefore, the model is, with 
that exception, passive. A third omission is the pos- 
sibility of making a given input lead excitatory at 
one time and inhibitory at another; thus, there is 
no equivalent here to the presumed functional change 
of presynaptic fibers dependent on post-synaptic 
membrane potential (Farr, 1954; GRUNDFEST, 1959). 
We shall show, however, that despite these deficiencies, 
the model is sufficiently complete to simulate a number 
of biological phenomena. 

The neuromime has three primitive input-output 
properties. They are one-to-one, where a single spike 
elicits a single spike; one-to-many, where a step func- 
tion or steady potential results in a train of output 
pulses (as in peripheral transducers) ; and many-to-one, 


Excitatory I = 
inputs 


Inhibitory 
input = 


Fig. 1. Circuit diagram of artificial neuron 


in which spatial or temporal summation occurs. (We 
ignore for the present a fourth possibility, namely 
those outputs which result from no input, as in spon- 
taneous firing.) These properties which include such 
time-varying characteristics as excitation, threshold 
and inhibition are sufficient to produce a vast number 
of logical functions. These include “and”’, “or’’, “not”, 
“if-and-only-if”, addition, subtraction and division, as 
well as more complex operations such as filtering, 
differentiation, and counting. 


Some properties of the model 


Some of the typical characteristics of the neuro- 
mime are illustrated in this section. These are the 
primitive properties of the circuit shown in Fig. 1 and 
do not include functions such as accommodation and 
adaptation. ‘It will be shown later how these more 
complex operations can be built up from the primitive 
ones. 

Due to component tolerances, there is some spread 
(on the order of 10%) in performance between units. 
The following results show the measured responses 
of an average unit. 

Time-intensity trade. For a given pulse input to 
a biological neuron, there is a minimum time required 
for a given intensity to elicit a response (ARVANITAKT, 
1938). The behavior of the model closely approximates 
ARVANITAKI’s strength-duration results as is shown in 
Fig. 2. We see, for example, that a 2.7 V stimulus 
must be at least 1.0 msec long to cause firing, while 
one having an amplitude of 1.68 V must last for a 


7* 


92 Leon D. Harmon: Studies with Artificial Neurons. I 


minimum of 3.0 msec. The horizontal asymptote of 
this curve, roughly 1.5 V, represents the rheobase. 
The shape of the curve is a direct consequence of 
the exponential input characteristic. The instanta- 
neous potential H (#) available at the summing input 1s 


E(t) = Emax (l—e—"*) (1) 


35] 


& 
~ 


27 


Intensity in Volts 


@ / 4 o a 5) 
Time in milliseconds 
Fig. 2. ‘Time-intensity trade for threshold firing. Since firing occurs just 
at the termination of the stimulus, the curve also represents the 
strengthlatency relationship 


Time between two pulses in msec 
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Threshold for single 
0.8msec pulse 
Vig. 3. Temporal summation for two 0.8 msec pulses of equal amplitude. 


Indicated times are from the termination of the first pulse to the onset 
of the second. Amplitudes are those required to just elicit firing 


Threshold in Volts 


Time in milliseconds 
Fig. 4. Exponential refractory recovery of artificial neuron. This relatively 
refractory phase is preceded by the absolutely refractory time (output 
pulse duration) which terminated at ¢=0. Curve A results from the use 
of one input lead; the recovery in B is due to more effective excitation 
derived from three input leads used in parallel 


where Ey,ax is the amplitude of the pulse stimulus, and 
kis the time constant of the input integrator (1.2 msec). 
Kach point on the curve represents the condition 
E(t) = Eypeovase = const. Thus as the intensity (Zax) 
is increased, ¢ must decrease. 'This is the equivalent 
of the familiar relationship 


Tyneobase — J stimutus (1 —e—tk) 


: 
: 


Kyberne 


Latency. Latency in the model is ian 
defined as the delay of impulse initiation in respon 
to a stimulus of long duration. Since there is I 
internal regenerative process contributing significan 
to firing delay after the removal of a stimulus, latenc 
is principally due to the gradual build-up of potenti 
in the input integrator. Firing occurs as soon ; 
threshold is exceeded. Hence, the strength-duratic 
curve of Fig. 2 is also a strength-latency curve. The 
results are similar to those described for motoneuro1 
(FRANK & Fuorres, 1956). The curve is asymptot 
to about 0.5 msec which represents the minimw 
firing delay in the pulse generating circuit. 4 

Temporal summation. The time-intensity eo 
ships required for the sum of two subthreshold puls 
to elicit firing are given in Fig. 3. Each point alor 
the abscissa indicates the elapsed time between tl 
end of the first pulse and the onset of the secon 
Points along the ordinate indicate the minimum pul 
amplitude (equal for both pulses) required to ju 
elicit a response. This behavior too, is the straig] 
forward result of the input integration characteristi 
and it is similar to the synaptic summation describe 
by Ecctizs (1946). q 

It is seen that time and intensity in the mod 
can be traded over a range of about one volt, w ic 
amounts to approximately 10% of the amplitude 
a typical output pulse. Summation can be achiev 
over a time ranging from 0 (temporal coincidenc 
to about 3 msec, for which time the required amplituc 
of the first pulse is sufficient to exceed resting thres 
old. Longer time constants of facilitation may | 
readily obtained by introducing additional integrat 
elements (R and C) at the input. 4 

Refractory recovery. Typical recovery after fi 
is shown in curve A of Fig. 4. This is similar | 
recovery of biological neurons after inactivation (HI 
LANGER & GASSER, 1937; HopGKin & Hux ey, 1952 
The neuromime is absolutely refractory for approx 
mately 1 msec, the duration of the output pulse; 1 
relative refractory state, beginning at t=O in 1 
illustration, starts at the cessation of the pu 
(ApRIAN, 1921). This exponential recovery tow: 
resting threshold has a time constant of 2.7 m 
Recovery is effectively complete in about 20m 
since a rheobasic stimulus applied at this time » 
once again elicit firing. ‘ 

This curve results from the use of one input le 
In B, three leads, used in parallel, increase the e 
of a stimulus. Thus, the refractory level will a 
reduced while its time constant remains unchal 

Output pulse. The all-or-none rectangular ou 
pulse has relatively constant amplitude; its wi 
however, changes somewhat as a function of f 
frequency. This is shown in Fig.5. This beh: 
is a consequence of several interacting circuit 
meters and was not deliberately designed. It 
slight effect on temporal integration (reducin 
efficiency with increasing frequency up to 500 : 
but probably negligibly alters the neuromime’ 
havior. Diminution of spike amplitude with increas 
frequency has been described by Rensuaw (1 
Kurrier (1953) and others. If the subsequent eff 
tiveness of a spike is determined by its energy (ti 
amplitude integral), then reduction of pulse-width ¥ 

pps = pulses per second. - 
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sasing frequency can have the same end result ag 
litude change. Such duration-amplitude inter- 
eability is known to hold, for example, in the 
documented time-intensity trade relationships. 


Jelay. This term refers to the time between the 
nning of a driving pulse and the onset of an output 
e during continuous pulse stimulation. It is not 
icy in the usual sense. Latency, generally measur- 
or single pulse or for step-function stimulation, 
- not involve post-firing refractory phenomena. 
vy in the model is a function both of excitatory 
esses (input integration) and of refractory reco- 
. Typical behavior is shown in Fig. 6. 


Jurve A depicts the delay as firing frequency is 
ed and applied to a single input lead (k = 1.2 msec). 
driving frequency of about 250 pps is reached, 
driven unit “drops out’’, and its firing frequency 

discontinuously to a lower value. This pheno- 
on is due to some interesting relationships between 
input and refractory time constants which will be 
ussed later. 


Jurve B illustrates the behavior for all five inputs 
pped together making k=0.46 msec. Here the 
en unit “follows” the input pulses up to its 
imum rate. In addition, the amount and varia- 
y of the firing delay is reduced. In both cases A 
B delay increases with frequency because pro- 
sively less refractory recovery is encountered at 
onset of each driving pulse. 
Repetitive firing. The generation of a continuous 
o of impulses for a constant stimulus is readily 
eved by the model. Repetitive firing in neurons 
been attributed to interaction of a constant 
ulus with refractory recovery (ADRIAN, 1930; 
Z, 1936). In another view (HopGKIN, 1948), it is 
mction of a periodic internal excitation process 
ch must be repeatedly “charged-up”’ by the con- 
t applied stimulus. The repetitive firing charac- 
tic of the present model combines both viewpoints 
e the input integrator is partially discharged with 
1 firing; this works in combination with the ex- 
ential refractory characteristic to determine re- 
tion rate, although the latter parameter is the 
inant one. 
fig. 7 shows firing frequency as a function of 
dy input voltage for two different input configura- 
s. Curve A results from the strapping together 
hree of the five excitatory input leads to obtain 
ntegration time constant of 0.66 msec. Curve B 
btained by using a single input lead where k= 
msec. 
When driven by a steady input, both configurations 
luce reliable firing frequencies over a range of 
at 50—600 pps. When a pulse source is used (such 
nother unit) the response frequency has no mini- 
a. 
if an extremely low firing frequency for small, 
dy excitation levels is required, an external feed- 
< loop from output to inhibitory input readily pro- 
ss it. Fig. 8 shows the arrangement. 
Zach output pulse is integrated with a time con- 
t t which is determined by the choice of R and C, 
is applied to the inhibition input. Consequently, 
caying exponential voltage appears at the inhibi- 
input after termination of the output pulse. 
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Diode isolation! is required to prevent C from dis- 
charging into the output line. The effect of this 
circuit is simply to prolong the relative refractory time. 

For k=0.5 MQ and C=1.0 uF, stable repetitive 
firing continues smoothly down to 5 pps. This is 
shown as dotted extensions of the curves of Fig. 7 


Pulse duration in milliseconds 


Firing frequency in pps. 
Fig. 5. Variation of output pulse width (duration) with firing frequency. 
Pulse amplitude remains constant 


Delay in milliseconds 


0 /00 200 300 400 500 600 
Firing frequency in pps. 
Fig. 6. Total delay from the beginning of a stimulus pulse in a repetitive 
train to the firing of a typical unit. Characteristic A holds for a long 


time constant input integration; B results from a shorter time constant 
See text for details 


and concomitant stronger excitation. 
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Input in Volts 
Fig. 7. Repetitive firing frequency as a function of stimulus level for two 
different input configurations. A — Three input leads used in parallel. 
B — One input lead. Stable firing down to 50 pps is obtained. This lower 

limit can be extended by a simple circuit addition 


Ces alll 
OME 2 YO ORS 


Repetitive firing frequency in biological prepara- 
tions has been shown to be approximately logarith- 


1 The only elements besides the basic model circuit used 
in any of the experiments described are resistors, capacitors, 
and diodes. The first two components are generally employed 
to provide additional integrative mechanisms and decremental 
conduction. Diodes may be considered as rough analogs of 
some synaptic mechanisms and are introduced only where 
their logical function does no violence to neurophysiological 
evidence. 
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mically related to the stimulus intensity on receptors 
(HartLine, 1938; GRANIT, 1947: Katz, 1950); in other 
studies firing frequency has been found to be linearly 
dependent on generator potential up to 60 pps 
(FuortEs, 1959) and up to 300 pps (Karz, 1950). The 
frequency-excitation curves of the neuromime (Fig. 7) 


Fig. 8. Circuit arrangement to extend low-frequency limit of stable firing. 
Self-inhibition prolongs the refractory period 


are quasi-logarithmic. The low-frequency sections are 
essentially linear; characteristic A lies within 3% of 
linearity up to 300 pps, while B lies within this limit 
up to about 250 pps. When driven by nonlinear trans- 
ducer elements such as photo-resistors, the over-all 
response of the neuromime is very close to log-linear 
over more than four decades of light intensity change. 


Equivalent noise in microvolts 


e-Freguenc 
| CU bit 


a = 50pps, 
-/ 
io" 


40 80 120 160 200 240 280 
Firing frequency in pps. 
Fig. 9. The lower limit of firing frequency is determined by noise in the 
system. During exponential refractory recovery, the difference between 
instantaneous threshold and resting threshold at any instant can be stated 
as a voltage. Firing will occur whenever a superimposed signal (referred 
to as equivalent noise) exceeds this difference. If time is expressed as 
frequency, then for any level of equivalent noise there is a corresponding 
repetitive firing frequency. See text for detailed explanation 


520 360 


Repetitive firing as a function of exponential re- 
fractory recovery exemplifies an interesting charac- 
teristic of dynamic systems which is often neglected, 
namely, the role played by noise. Consider, for ex- 
ample, a neuron which has an exponential refractory 
period having a time constant of 2.7 msec. Theoreti- 
cally, resting threshold is approached only asymptoti- 
cally and is reached in an infinite time. Practically 
of course, refractory recovery is measured as complete 
in only a few time constants, generally less than 
20 msec. This is true only because of noise in the 
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system, for instance minute variations in thresho 
or excitation. 

In the case of repetitive firing of the model und 
d.c. stimulus, the lowest firing frequency is abo 
50 pps. Just below this minimal stimulus, firing ceas 
abruptly. The effective recovery time thus is abo 
20 msec. Since the refractory time constant tT 
2.7 msec, recovery is complete in about 7.5 time co 
stants. What does this imply about noise in f 
system? Why is the firing frequency not arbitrari 
low @ . 

The threshold recovery function, defined as R (é), 


R(t) =R (1—e), ( 


where R is the threshold increase at the start of tf] 
relative refractory period. We can calculate RK (é) f 
different values of ¢ in order to find the extent _ 
refractory recovery at various times. For exampl 
at 37, 

RO)=j=R le) == SOV: 
recovery is complete to within 5% of resting threshol 
If the refractory recovery spans, say 10.5 V (see . 
Fig. 4), then the distance to resting threshold at ; 
is 5% X 10.5 V=525 mV. At this point a signal, ; 
uncertainty, or a noise having a magnitude of 525 m 
(and the proper polarity) superimposed on the recove 
ing threshold will bring it to the asymptotic (restin 
level. A plot of such points, based on a threshold 
1.5 V and a refractory time constant of 2.7 msec 
shown in Fig. 9. : 

Rather than have an abscissa calibrated in tim 
it is more revealing to indicate frequency. Thus t 


3t point discussed above appears at msec: 


1 
3X 2.7 
123 pps. 

The low-frequency cutoff of the neuromir 
(~ 50 pps) corresponds to a recovery within 6m 
(0.4%) of resting threshold. Thus, any fluctuati 
in the “steady” stimulus, or noise in the circuit w 
cause firing at this time if it exceeds 6 mV. If reliak 
repetitive firing down to 25 pps is required, then 1 
more than 4uV noise may be present, a most u 
likely situation. | 

On the average, the measured peak noise signi 
at the input in the absence of a stimulus are typical 
1.5 mV with occasional peaks of 2 or 3 times tl 
amplitude. The stimulus lead was found to ha 
about 1 mV peak noise on its “‘steady” signal. TI 
establishes the theoretical low-frequency cutoff 
between 45 and 50 pps, in good agreement with o 
served behavior. 


This approach may have some utility in the 
vestigation of internal fluctuations in biological ne 
rons. Some experimental and theoretical work h 
already been done on threshold variations and interr 
noise (PECHER, 1939; Farr & Karz, 1952; FRIs 
korpr & Rosensiiru, 1958); the technique describ 
above might be used to amplify such results. 


Complex properties of the model | 

In order to exhibit some of the more complicat 
functions of neurons, external circuits must be a 
pended to the neuromime. Such phenomena as ¢ 
commodation, adaptation, self-sustained discharge ai 
post-spike polarization may be achieved. | 


i 


; 
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A number of these effects are derived from a 
uit in which a stimulus both excites and inhibits. 
s follows from Hri1’s (1936) proposed internal 
ommodation process which is dependent upon but 
ch proceeds at a rate different from that of a 
ultaneous excitation process. H1~L showed that 
ny aspects of neural excitability could be rather 
| accounted for by invoking a time constant k for 
itation and a considerably larger A for the time 
stant of dependent accommodation (threshold 
nge). 

An equivalent concept can be proposed as follows: 
threshold remain constant, and substitute inhibition 

accommodation. Consider inhibition to be the 
ation of excitation and that linear superposition 
ds. Since excitability is measured by the difference 
ween excitation and variable threshold in H1I1’s 
del, it is equivalently measured by the difference 
ween nei excitation and fixed threshold! in the 
srmative view. If the excitation and inhibition 
chanisms have appropriate time constants, then the 
» points of view are identical. 

These two equivalent concepts are schematized in 
‘10. The three sets of curves on the left illustrate 
_ Hill model of accommodation where V is the 
‘iable excitation and U is the resultant threshold. 
ing occurs only if V>U, not therefore present for 
dition (1), just barely occurring in (2), and lasting 

the interval shaded in (3). 

In the curves on the right, threshold 7 is fixed. 
r firing to occur, excitation H less inhibition J must 
ult in a net excitation N which exceeds threshold. 
ain there is no response in (1), momentary firing 

(2) where NT, and sustained firing in (3) as 
gas N>T. 

Both excitation and inhibition are obtained from 
‘timulus by the circuit of Fig. 11. The inhibition 
1e constant, determined by the choice of & and C, 
nade large compared to the excitation time constant. 

A number of well-known neural phenomena are 
yroduced by using this circuit. They are described 
the following sections. 

Transient change of excitability. The ‘‘accommoda- 
n’’ process described in the foregoing section can 

used to simulate many of the well-documented 
nsient excitability phenomena. This follows directly 
m the fact that a subthreshold stimulus will produce 

early and fast reduction in threshold as the ex- 
atory input integrator builds up potential. Con- 
juently, the additional stimulus required during this 
riod to exceed threshold and cause firing is reduced. 
reshold subsequently rises (more slowly) to its rest- 
; value or beyond as inhibition (accommodation) 
pervenes. 

One method of exploring transient excitability uses 
subthreshold constant stimulus. RusHron’s (1932) 
ults are typical. He showed that during the applica- 
n of a subthreshold constant current, the amplitude 
a brief test pulse required to elicit firing decreases. 
r the particular nerve tested, this decrease had a 
rp onset, reached its maximum value at about 
) msec, and then slowly subsided to initial conditions 
5—10 msec. 
1Threshold is constant in this view only for prefiring 


sting) processes. It is considered to be a variable, however, 
h respect to the refractory period. 


Similar results found in the neuromime are shown 
in Fig. 12. Each curve was taken for a different con- 
stant subthreshold voltage applied at t=0. The ordi- 
nate value of a given curve at any time is the ampli- 
tude of a superimposed 0.5 msec test pulse required 
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Fig. 10. Equivalent concepts of firing criteria. In HILL’s model (left). 
excitation V must exceed accommodated threshold U for firing to occur, 
An alternative view (right) assumes a constant threshold. The criterion 
for firing is that net excitation N exceeds threshold 7. Net excitation 
is the difference between an excitatory stimulus # and a concurrent 
inhibition I 


to cause firing. One input lead was used (k = 1.2 msec), 
and the time constant of inhibition (analogous to 
Hitw’s A) was 3.7 msec. 

RUSHTON’s curves were asymptotic to resting 
threshold; no residual accommodation appeared. This 


Excite 


Hig, 11. “The circuit configuration used to obtain stimulus-derived inhibi- 
tion. Part of any stimulus (excitation) voltage is integrated and applied 
to the inhibition input 


is due to the fact that the conditioning stimulus was 
removed just after the test stimulus was applied. The 
curves of Fig. 12 approach a constant inhibition level 
representing a higher-than-resting threshold; the con- 


1 We adopt the symbol A for the inhibition time constant. 
To calculate A, the 53 KQ total resistance of the inhibition 
input circuit (comprising the 24 KQ resistor and the base 
resistance of 7’;) must be included. For C=0.1uF and 


R=120 KQ, 
yaa DorLOESEX 120 - 107% 
7 L3H 1052 


= 3.7 msec. 


<0 
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ditioning stimulus was left on indefinitely in this case. 
Any asymptote can be chosen simply by modification 
of the inhibition network. Similarly the time at which 
peak excitability occurs also is variable. Rheobase 


Amplitude of test 
pulse in Volts 


Time in milliseconds 


Fig. 12. Transient change of excitability upon the application of a constant 

subthreshold stimulus. Ordinate values represent the amplitudes required 

of a 0.5 msec test pulse at various times to cause firing. Maximum facili- 

tation occurs at 1.3 msec. Each curve represents different levels of 
conditioning stimulus 


becomes 2.5 V for the configuration shown, due to the 
concurrent inhibition. 

Another technique for exploring transient excita- 
bility uses a brief pulse rather than a constant current 


200 


/60 


% Normal excitability 


Time in milliseconds 
Fig. 13. Transient change of excitability following a 0.5 msec conditioning 
stimulus. Ordinate values indicate excitability relative to resting threshold 
(100%). Excitability is established by measuring the amplitude of a 
second 0.5 msec test pulse required to elicit firing. Threshold is lowered 
immediately following the conditioning stimulus, passes through rheobase 
in less than 0.4 msec, and reaches a maximum at = 0.8 msec, gradually 
returning to its resting value. Curve A results from’a low amplitude 
stimulus; B and C represent increasing levels. In D the stimulus was 
suprathreshold, thus the time course of excitability follows the refractory 
recovery characteristic 


as a subthreshold conditioning stimulus. This is fol- 
lowed by a test pulse to determine threshold. Typi- 
cally it has been found (ERLANGER & GassER, 1937) 
that the facilitating effect of the conditioning pulse 
is proportional to its strength, diminishing rapidly 
after the stimulus is removed. A subnormal phase 
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follows, having a peak (threshold maximum) at abo 
0.5 msec for the class of fiber tested, which gradual 
returns to resting threshold within 3 or 4 msec. Simil 
behavior in the neuromime follows from the mec 
anisms operating for a constant conditioning stimul 
as described in the preceding section. These chang 
in threshold have been converted into proportion 
excitability and plotted in the curves of Fig. 13. Kai 
point on a curve represents the percent ratio of restit 
threshold to instantaneous threshold. 

A subthreshold conditioning pulse of 0.5 msec dur 
tion was terminated at t=O, and a variable amplituc 
test pulse 0.5 msec long was used to determine thres 
old at a number of time intervals. Curve A was derive 
from a very weak conditioning stimulus; curves 
and C were taken for increasing amplitudes of co 
ditioning pulse. In D, the conditioning stimulus e 
ceeded threshold and the unit fired. This curve th 
represents refractory recovery. These results close 
parallel those of ERLANGER & GassER. Recovery | 
each case is to resting threshold (100% excitabilit 
since there is no long-lasting stimulus to mainta 
accommodation. 

Pulse trains. For a stimulus of indefinite duratic 
whose level is above threshold but below some critic 
value, a burst of output pulses will occur for a time 
during which accommodation has not yet overtake 
excitation (H1LL, 1936; Karz, 1936; Hopexrn, 1948 
Katz demonstrated a linear relation between tl 
logarithm of relative excitation (In J/Ij) and bur 
duration, obtaining a family of such lines for varior 
accommodation time constants 4. | 

This behavior in the neuromime also follows d 
rectly from the stimulus-derived inhibition describ 
above. The results shown in Fig. 14 closely approx 
mate those described by Karz. 

The measured average excitation time constant 
was 1.0 msec for the units tested ; this value was mai 
tained for all results described below. The inhibitic 
time constant 2 was adjusted by varying C (Fig. 1 
from 0.5 uF (A=21 msec) to 5.0 uF (A=210 msec 
holding F constant at 200 KQ. It is seen that the bur 
duration is a linear function of In Z/E, where = 
the stimulus level used to elicit the burst and Hy 
rheobase. As Karz pointed out, Hi1’s results imp 
that the relationship of burst duration to stimulati 
current, threshold, and excitation and accommodatic 
time constants is 


1—k/A 
and if k/A ~ 0, as is found in nerves showing repetiti 
response, then 

trwAlnI/Iy. ol 


This is the result obtained from the model and plott 
in Fig. 14. We expect to find that when J = ¢I,, t= 
The points shown in the figure are located at the 
expected values. The measurements were made f 
voltages # rather than for currents J. | 


Burst duration lengthens as excitation is increas 
to a critical level, beyond which sustained firing ocew 
This occurs because the inhibition circuit saturat 
at a somewhat lower level than does the excitati 
circuit. Consequently at very high stimulus leve 
steady-state net excitation is above threshold, ai 
the burst becomes indefinitely long. | 
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Increased duration of burst implies greater num- 
rs of pulses per burst, since frequency of firing also 
es up with increased excitation. The discrete steps 
served in this process are shown in Fig. 15 A. 

For an inhibition time constant of 5.2 msec there 
e only four levels before sustained firing occurs. As A 

increased so that accommodation lags more and 
ore, greater numbers of levels occur. 

In Fig. 15B it is seen that for 2 =210 msec, bursts 
more than 110 pulses occur. Individual steps have 
t been plotted for these curves beyond the first 
w levels. Sample points were taken at the higher 
vels and smooth curves drawn for simplicity. 

For an excitation time constant which is short 
lative both to typical interpulse periods and to in- 
bition time constant, net excitation rises quickly and 


25 


0 50 100 450 200 250 300 ~=350 400 8450 
Burst duration in milliseconds 
14. Relation between multiple-response (burst) duration and relative 
itation for various time constants of inhibition (accommodation). The 
nts shown are theoretically predicted values of burst length when the 
excitation H# is « times the rheobase E, 


bsides slowly. This results in adaptation which 
nsists of a high initial firing frequency which dimin- 
1es as the burst progresses. When output frequency 
measured as a function of time for several different 
hibition time constants, the curves of Fig. 16 result. 
uch of these curves was derived from a constant 
plied stimulus 7.4 x rheobase, (In H/H,=2), hence 
ey all start at essentially the same frequency. The 
rm of each curve is exponential, reflecting the expo- 
ntial course of the growing inhibition. Firing ceases 

about 50 pps, the low frequency cutoff described 
rlier and shown in Fig. 7. 

Examination of the total number of pulses in a 
rst for each value of A suggested a relationship 
1ich has not been previously obvious. As shown in 
e curves of Fig. 17, it appears that the pulse number 
a linear function of inhibition time constant. This 
Ids over a wide range of stimulus levels. Curve A 
sults from In £/H,=2; in B, In E/E,=1.5, and C 
osresents the condition In H/E,)=1.0. 

That this relationship must hold is evident if the 
actions shown in Fig. 16 are considered more care- 
ly. Since each curve represents firing frequency f 

a function of time, the area under each curve must 
equal to the total number of pulses, V. That is, 

ie 


N= f f(t)dt. (5) 
0 


The net excitation available to the neuromime is 
» stimulus-derived excitation less the stimulus- 
ived inhibition. In the circuit used, these two 
nponents are approximately equal! so that in the 
1 This is equivalent to Hit1’s (1936, p. 319) assumption 
fu. —Vi=U;—Vo- 
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steady-state the net excitation lies just below thresh- 
old. Both excitation and inhibition are exponential 
functions; thus, net excitation 

K(t) ~ Enax (1 ee) aR Emax (1 —e ta) (6) 
where Ey,ax is the stimulus amplitude, and & and A 
respectively are the excitation and inhibition time 
constants. For the production of bursts, accommoda- 
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Number of pulses 


ot) 


Excitation in Volts 
Fig. 15A. The number of pulses in a transient burst increases with ex- 
citation and with inhibition time constant 4. Above a critical stimulus 
level, continuous firing occurs 


120 


Excitation in Volts 


Fig. 15B. The number of pulses in a burst as a function of excitation 
for large values of 2. Smooth curves rather than discrete steps have been 
drawn for simplicity where the pulse count becomes large. Over 110 pulses 
have been observed in a burst for an inhibition time constant of 210 msec 


tion must rise much more slowly than excitation, hence 
for the case of interest k</A. Hence Eq. (6) can be 
simplified to 


E(t) } Emax €!. (7) 
From Fig. 7 we have the approximate relationship 
f(t) =c£(t) (8) 


where f[(é) is instantaneous frequency and ¢ is a con- 
stant of proportionality. Thus we can rewrite Kq. (5), 
the expression for the sum of the pulses, as 


P 
Nave J Emax €* dt (9) 
0 


ww CE max A (1—e-"). (10) 
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T is the time at which firing ceases. This occurs 
at a definite firing frequency, f,, which is the same 
for all A (about 50 pps) as shown in Fig. 16. Hence 
from Eqs. (7) and (8) 

fire Ch awee tt (11) 


400 


Tota/ No. 
of pulses 


S 
Ss 


Firing frequency in pps. 
do 
S 
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0 100 200 300 400 500 
Time in milliseconds 
Fig. 16. Adaptation during a burst for various inhibition time constants. 
A step-function stimulus of 7.4 x rheobase causes initial firing rates of 
~ 350 pps in each case; concurrent inhibition supervening at a rate de- 
pendent on A eventually terminates each burst at *50pps, the 
lowfrequency cutoff 


Substituting (11) into (10), we have 
N w A(cEmax —f,)- 
Since c, Eyax, and f, are constant, 
Nad, approximately. 
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Total number of pulses in burst 


0 50 100 /50 200 250 
Inhibition time constant x 
Fig. 17. The total number of pulses in a transient burst is a linear function 
of the inhibition time constant for any given stimulus level. A results 
from a stimulus 2 where In E/E, =2. In B, In E/E, =1.5; in C, In £/E, = 
1.0. This is predictable from the nature of the time course of the 
stimulusderived inhibition. See text for detailed analysis 


The approximate nature of the relationship arises from 
the nonlinear firing frequency characteristic, the fact 
that final net excitation is not exactly zero, and the 
fact that & is not vanishingly small. For the cases 
considered, the approximation is accurate to within 
5%, hence with this limitation we can write 
Nad, (12) 
that is, the total number of pulses in a burst is directly 
proportional to the inhibition time constant. The close- 
ness of the approximation is evident in the linearity 
of the curves in Fig. 17. 
It would be interesting to know if this result can 
be verified experimentally for biological preparations. 
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It is implicit in the work of Katz and in the exponer 
tial nature of accommodation, as was shown above 
Confirmation could be useful, since counting the nur 
ber of spikes in a burst may provide an index ¢ 
accommodation time constant more easily obtaine 
than by the use of conventional experimental techn: 
ques. It should also be noted that for the condition 
discussed, adaptation mirrors accommodation; thei 
time courses are identical. Hence in this case th 
accommodation time constant can be inferred from 
measurement of adaptation. 

By varying the inhibition parameters (level an 
time constant), a wide range of accommodation an 
adaptation can be exhibited. Without inhibition, n 
accommodation and no adaptation occurs; rheobas 
stimulation elicits repetitive discharge which is cor 
stant in frequency. For moderate inhibition, as de 
scribed, rheobase stimulation elicits one or two pulses 
increased levels of stimulation evoke bursts or repeti 
tive discharges which exhibit accommodation an 
adaptation. This variety of behavior is seen in th 
results described by HopexKin (1948) for a large clas 
of motor neurons and sensory receptors. | 

Self-sustained discharge. There are two basic kind 
of mechanisms which can give rise to continuous act 
vity (i.e., oscillation) in the absence of external stimul 
In one, a closed chain of neurons propagates reverbera 
tory activity around a loop (LORENTE DE NO, 1949 
The minimum number of units required in the loo 
is determined by pulse amplitudes and durations an 
by refractory time constants. Any given unit must re 
cover sufficiently before the next stimulus comes along 

The second class of self-sustained oscillators de 
pends on positive feedback around only one neurot 
This feedback may be due to internal mechanism 
or to a feedback loop around the entire unit, as ma 
occur in recurrent axon collaterals. An output-derive 
potential in the neuromime can easily be integrate 
and fed back to form an adequate excitation stimult 
for self-sustained discharge. In this case, maximw 
firing frequency is limited by the refractory time co! 
stant and the available output level. 

The two kinds of circuits are shown in Figs. 
and 19. In Fig. 18, where curve A is for one excitatio 
input lead, a minimum of seven units is required f 
oscillation. As more units are added, oscillation al 
tinues, but because transit time through the loop it 
creases, firing frequency decreases. If all five inpt 
leads are strapped together (curve B), the more effe: 
tive excitation causes firing earlier in the recover 
cycle; hence fewer units and higher frequencies a 
possible. 

In this type of self-sustained discharge circuit, th 
upper firing frequency is determined by the trans 
time in the shortest possible loop. There is no lim 
on the lowest firing frequency; this is determine 
solely by the total number of units in the loop. 

In the single-unit oscillator of Fig. 191, the firir 
frequency is independent of @ as C is made larg 


* Note how this circuit differs from that of Fig. 8. J 
both circuits a potential derived from the output is fed bat 
to an input. However, in the case of the oscillator (Fig. 1 
the feedback is positive; an output signal is applied to % 
excitatory input. This action is regenerative. In contra 
the circuit of Fig. 8 utilizes negative feedback since the outpu 


applied to the inhibitory i h 
atlivity: ry input, tends to depress furtll 
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sufficiently large capacitor insures a fully smoothed 
tput waveform. That is, the output pulses are 
tegrated to yield a feedback excitation voltage which 
relatively constant, being the peak amplitude of 
e output pulse. As C is decreased, the average 
sdback voltage is diminished, and firing frequency 
ops off until available excitation does not exceed 
stantaneous threshold. Thus the lowest possible 
ing rate for this type of reverberatory circuit is 
ced, unlike the multiple unit loop circuit. The upper 
nit of firing frequency, which is determined by the 
ak output voltage, is likewise bounded. 

Curve A depicts the case for three input leads 
rapped together. Oscillation becomes impossible if 
ore leads are connected in parallel, i-e., if the input 
ne constant & is made smaller than 0.66 msec. There 
e two reasons for this. As k is reduced, latency is 
creased. Hence excitation derived from an output 
ise occurs earlier, when refractory recovery is less 
mplete. Secondly, reducing k means that C is dis- 
arged sooner, with the result that the feedback 
citation is drained more rapidly. Curve B results 
9m using one input; here latency is increased, hence 
e repetition rate is lower. 

A special case of summation. During the course of 
ese experiments an unusual and unsuspected pheno- 
enon was found. It may have no relevance to bio- 
gical behavior, but it does illustrate an interesting 
ditional property of neuron-like entities. 

If one unit is used to drive another directly, and 
e pulse amplitude is sufficiently high, then one would 
pect the second to “‘follow”’ the first, pulse for pulse. 
1is is, in part, what is observed. At relatively high 
squencies, however, the second unit begins to “‘drop 
it’; ie., at some point the pulse amplitude of the 
st is insufficient to exceed the relative refractory 
reshold of the second. But if three (or more) of the 
citatory inputs of the second unit are strapped 
sether to utilize the driving pulses more effectively, 
en following is complete up to the maximum possible 
ing rate. This action was mentioned briefly in an 
rlier section dealing with delay. 

Consider now the following experiment. Suppose 
at at some relatively high frequency (say 400 to 
0 pps) one unit is following another, pulse for pulse. 
ich one-for-one following has been described by But- 
cK (1946) and by Fursupan & Porter (1957). Now 
; the output amplitude of the driving unit be mono- 
nically reduced, “‘starving’”’ the driven unit. This 
uld represent a case either of decremental conduc- 
m. of spikes or a change in threshold of the recipient 
uron. As the driven unit receives progressively less 
citation, there will be a critical point at which a 
yen driving pulse has insufficient energy to fire the 
iven unit. However, it turns out that when the 
xt driving pulse comes along, it is integrated with 
e preceding one to cause firing. In other words, 
mporal summation occurs, and the firing frequency 

the driven unit is half that of the driver. One 
uld expect that as the driving pulse amplitudes 
> reduced still more, every third pulse would be 
ective, then every fourth! etc., so that f,/f, which 


1 Summation becomes ineffective for more than n pulses 
en the time from the first to the nth pulse exceeds the 
sctive integrating time at the input of the driven unit. 
pically this limit is 2 or 3 pulses. However, refractory 
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was originally unity, progresses integrally 1, 2,3, 4,... 
This is what one reasonably expects to happen, but 
in fact it does not. What does occur is shown in 
Fig. 20. The ratio of /,/f, has been plotted for con- 
venience. It is seen that for decreasing excitation 
at the second unit, the integral steps expected show 
up, but considerably more complex behavior also 
appears. Thus the predicted steps are seen as 1:1, 
1:2, 1:3 ... 1:10 (frequency division has been ob- 
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Fig. 18. Self-sustained discharge in a chain of N units. A minimum of 7 is 
required when a single input lead is used (A). With more effective ex- 
citation obtained by five input leads in parallel (B), only 4 units are re- 


quired to sustain oscillation. In each case, as more units are added to 
the chain, firing frequency diminishes 
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Fig. 19. Self-sustained discharge obtained by a feedback loop around 


one unit. Increasing the output-pulse integrating capacitor provides a 

greater average level of self-excitation. Firing frequency thus increases 

up to the limit imposed by the maximum available output-pulse amplitude. 

Oscillation becomes impossible when the filtering is inadequate to maintain 
sufficient stimulus level 


served up to 1:13). However a much larger number 
of nonintegral steps (such as 3:5, 5:16, 3:19, etc.) 
also appears. This cannot be explained simply on the 
basis either of summation or refractory recovery alone 
or in combination. 

It was found that the mechanism responsible for 
this curious behavior depends on phase relationships 


recovery additionally comes into play. Note that a pulse 
in such a continuous train of reduced amplitude pulses fails 
to excite because it is subliminal with respect to instantaneous 
(refractory) threshold, not to resting threshold. Hence some 
subsequent driving pulse will elicit firing when refractory 
recovery has progressed sufficiently. Therefore the 4th, 5th 
or nth pulse in a train can be effective. In this way a pulse 
frequency division occurs, every nth driving pulse causing 
the driven unit to fire. “‘Summation’’ can then be considered 
as a composite process; classical axon summation occurs for 
nonrepetitive stimuli, where each of a few subrheobase pulses 
are integrated to exceed quiescent threshold. In the case of 
repetitive stimuli, — J pulses in each train of » pulses fail 
to exceed the instantaneous dynamic threshold; this is 
iterated subtraction, i.e., division. 
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between pulses in both N, and V,. This can be seen 

in Fig. 21. 
The top line shows the output of the driving unit. 

Seven down-going pulses appear. The bottom row of 
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Fig. 20. Firing response of one unit being driven by another. ‘‘Following” 
is precise at high levels of excitation. As the driven unit receives pro- 
gressively smaller stimuli, it begins to drop pulses. The 1:2 and 1:3 steps 
result from ordinary temporal summation. Other ratios of firing frequencies 
stem from another phenomenon, caused by asynchrony between driving 
pulses and the refractory period of the driven unit 


pulse respresents the output of the driven unit. Note 
that, including the partial pulse at the right end, only 
six appear. One pulse, corresponding to the fifth one 
from N, has dropped out. This sequence repeats (not 


Output yas 


N, 
Base of 7, ¥¥ 
(Input) 


Nz 
Emitter of Tj- 
(Threshold) 


Fig. 21. Phase relationships between driving and driven units which explain 
the firing frequency relationships of Fig. 20. See text for detailed 
explanation 


shown) in such a way that there are only 4 pulses 
from NV, for every 5 pulses from N,. This corresponds 
to the 4:5 step shown in Fig. 20. 

The reason for this behavior can be seen by con- 
sidering the second and third traces of Fig. 21. In the 
second, the base of 7’, (input transistor, see Fig. 1) 
in N, reflects the (integrated) input pulses coming 
from N,. Consider the second pulse as a starting point, 


as indicated by the arrow. The voltage at the bas 
of 7, in the driven unit falls exponentially to a parti 
cular level as the pulse from N, charges up the inpu 
integrating capacitor. Meanwhile the emitter of 7 
(3rd trace) rises from a deep, fully inhibited level 
heading for the resting threshold level at a rat 
governed by the relative refractory time constant (th 
unit is just recovering from having been fired by the 
previous N, pulse). At the time that the potentia 
at the base of 7, is equal to the potential at th 
emitter, the firing threshold condition is satisfied, anc 
an output pulse in N, is initiated. This occurs just 
before the end of the second N, pulse. The base of 7 
reflects this firing by terminating the input puls 
integrating process and by being rapidly pulled in th 
positive (upward) direction. 

At termination of the output pulse, the base of 7 
is again free to integrate the next pulse out of N, 
Meanwhile the relative refractory phase, reflected ix 
the slow rise of potential on the emitter of 7',, has 
begun again as soon as the NV, output pulse terminates 
Note, however, that as this action repeats, the time 
at which N, fires becomes progressively later with 
respect to the N, driving pulse. This follows from the 
fact that the instantaneous magnitude of the NJ. 
threshold (refractory curve) is not phase-locked to the 
N, driving pulses. Thus a phase slippage can and 
does occur. Eventually (at the fifth pulse) this shiz 
accumulates to the point that by the time the driving 
pulse ends (the base of 7’, has reached its maximum 
excitation level), the refractory recovery has not heer 
sufficient to allow firing. Consequently a pulse is 
missed. 

Refractory recovery continues during this blank 
interval, more and more closely approaching resting 
threshold. Then the next V, pulse comes along. Since 
threshold is now quite low, firing occurs relatively 
early. Again the base of 7’, is discharged and awaits 
the next input signal. Thus the cycle is completed 
this point in time corresponds to the situation at the 
second pulse where the tracing of the sequence bem 

It would be interesting to examine biological pre: 
parations for the presence of this type of coding 
Auditory volleying, for example, may utilize suck 
mechanisms. : 


Uses for the model 


There are two distinct types of explorations whicl 
can be made with the described model. In one, singk 
unit properties can be studied in detail, and new ol 
unsuspected relationships may be suggested or dis 
closed. Such characteristics as the linear relation d 
number of pulses in a burst to accommodation tim 
constant, and the “summation-division” pulse-follow: 
ing function are examples of such results. 

At a higher level, group interaction properties sucl 
as the behavior of small networks and transduce! 
encodings, for example, may be studied. It has beer 
possible to explore systems at the retinal and oot 
levels with profit (van BercruK & Harmon, 1960) 
Such mechanisms as on, off, and on-off recepto 
systems, and dynamic range extension in spiral ir 
nervation networks have been examined with thal 
electronic models. Other studies have been made 0 
the possible neurological origins of flicker-fusion pheno 
mena and of primitive pattern recognition. | 
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The two papers following describe in detail two 
these explorations. Current and continuing work 
ntended to elucidate further some of the informa- 
n-processing mechanisms of peripheral neural struc- 
es. 


Increasingly detailed knowledge of neural function 

s made more and more complex our picture of the 
Iron. In a very real sense a unified and comprehen- 
e understanding appears to become more, rather 
in less, remote. However, it may very well be pos- 
le that a small number of basic properties accounts 
the essential computing functions of this element. 
‘tainly to a first-order approximation the cha- 
teristics discussed in this paper underlie much 
observed neural activity. A small number of primi- 
e relationships describe a large body of experi- 
ntal results. 


In the design of the electronic model, a few simpli- 

1 a priori assumptions were seen to have implicit 
them many functions of biological neurons. Con- 
juently, a fundamental theory of neural action may 
imately be much less complicated than the enormous 
ly of detailed study presently leads one to suspect. 
simplified, coherent view of neural events is highly 
sirable; neural analogs can provide a useful tool in 
proaching that goal. 
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Summary. 1. Artificial neurons (neuromimes) are used to 
simulate the external spiral innervation of the cochlea. 

2. On the basis of the experimental observations the 
proposition is advanced that the spiral innervation serves to ex- 
tend the dynamic range of the ear. Dynamic range extension 
follows from elementary considerations of the refractory and 
summing properties of nerve fibers. : re 

3. Experiments with different neuromime densities, sup- 
ported with psychophysical observations reported in the 
literature, lead to the hypothesis that dynamic range and 
growth of sensation are related to the innervation density in 
the area of sensory tissue under consideration (e.g., skin). 
The spiral nerves are considered as a special case of a more 
general sensory nerve, branching in binary fashion. _ 7 

4. The pathological phenomenon of “loudness recruitment 
is explained as a “thinning” of cochlear innervation density, 
giving rise to smaller dynamic range and faster growth of 
loudness. 


Introduction 


The innervation of the cochlea, according to 
LorEntE DE NO (1937) and FernAnpez (1951) can be 


4— Window 


ae 
ED aor 
“ 0D . x 
x ee ASO i9¢ A Inner cells 
/ uk CA SA hair 
7 i \ GEN cells 
Spiral 7 Bs A LS ‘ Radial 
erves i ¢ rs bi eee nerves 
~ ~— ae 
External -“ _--~~ ~s<2>=-== Internal 
Infernal -—~ ~~ External 
Vig. 1. Schematic drawing of the innervation of the cochlea; a segment of 


a turn is represented. Black arrows indicate direction of transmission. After 
LORENTE DE N6 (1937) and FERNANDEZ (1951) 


divided into four groups (see Fig. 1): 1. The internal 
radial fibers connect directly to one, or to very few, 
internal hair cells. 2. The external radial fibers, which 
cross the arch of Cortt, also connect to one or to a few 
external hair cells. 3. The external spiral fibers cross 
the arch of Cortr, course underneath the external hair 
cells and connect through side branches to numerous 
outer hair cells. 4, The internal spiral fibers run in the 
tunnel of Cortr and connect with side branches to 
many inner hair cells. This-last type of innervation 
is thought to be efferent (the other three are presum- 
ably afferent) and seems to be the terminal point of 
the bundle of Oorr and the tract of Rasmussen 
(Olivocochlear tract). 

‘Of the other three types of (afferent) innervation, 
the least seems to be known about the external spiral 
fibers, both as to anatomy and to function. LoRENTE 
DE N6 states definitely that the spiral fibers run in the 
direction of the base of the cochlea. FurnAnpnz (1951) 
believes that this is only partly true; he finds that 
there are many fibers which run in the opposite 
direction; a number of fibers even appear to split up 
and send branches in both the apical and basal 
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directions. Hetp (1926) shows the fibers in his pi 
tures as running predominantly in one direction, bh 
fails to state which direction this is. 

The anatomists are not in agreement on the lengt 
of these fibers (‘‘as much as one third turn” — LOREN 
pE NO; “‘a quarter turn” — Hxwp), and they are eve 
less definite about the number of side branches or | 
hair cells innervated (‘‘numerous” —LORENTE DE Né 
About the function of this type of innervation, r 
more than speculation exists. Davis (1952) thinks “ 
may allow spatial summation of weak local excitaton 
effects when the cochlea is stimulated by very fair 
sounds’. | 

This paper will trace a line of thought and prese1 
some model experiments which lead to an hypothes 
about the function of the spiral innervation. . 


Logical properties of nerve branches | 


It is beginning to be well known now that at bifu 
cations of nerve fibers, especially axonal termin 
arbors, there exists a certain probability that a pro 
gated impulse fails to pass into one or the other | 
even both branches (WatL, Letrvin, McCuLLoce 
Pirts, 1956). This conduction failure seems to 
purely statistical, i.e., it isnot possible to state wheth 
a given impulse will pass or fail. We may think of tl 
behavior as characteristic of divergent neural arbo: 


There are, however, also convergent neural arb 
such as the external spiral innervation and the sens 
innervation of the skin. Here (Fig. 2) conduction 
impulses is in a direction opposite to that in f 
divergent arbors. In this case, however, it is possib 
to state accurately when conditions are sufficient 7 
cause blockage of a particular impulse. Consider fl 
junction point J in Fig. 3. Here branch-fibers A ai 
B join to form fiber C. Suppose an impulse from Ah 
just passed through J; now J will be refractory for 
short time, and an impulse arriving at J from B w 
be blocked. It may also lengthen the refractory tim 
such that the next impulse from A can be blocked, at 
so forth, the sort of phenomenon perhaps responsil 
for Wedensky inhibition. The diminished amplitu 
of an impulse arriving at an incompletely recover 
section of nerve fiber may cause failure of this impul 
(see, for example, the phenomenon of nonintegi 
division discussed by Harmon in the preceding pape 
It may be argued that there is no reason why 
impulse from A should not antidromically invade © 
as well as go orthodromically into C. On closer insp 
tion, however, it is seen that an invading impu 
would make B refractory for a time amounting to t 
total travel time of the impulse in B plus B’s effecti 
refractory time. Effectively, then, the refracto 
period of J is extended by this amount of time for 
impulse originating in the sensory cell of B. Since t 
junction of branch B and its hair cell is presumal 
synaptic, the antidromic pulse would not affect t 
(presynaptic) excited state of the hair cell. Since 
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wssumed to be short, the total effective refractory 
e of J with regard to B is perhaps a factor of two or 
ee greater than local measurement at J would 
icate. Meanwhile though, J’s refractory time with 
ard to A remains at this “local”, lower value, and 
) probability of passage of an impulse from A is 
ferentially enhanced. Although this suggests an 
eresting mechanism for “neural funneling” (von 
KEsyY, 1958, 1959), we will not be concerned with it 


e. 

Clearly, the amount of blocking at J is closely tied 
the frequency of impulses in A and B. If both 
ches are firing at a very low rate, say around five 
‘second, and the firing epochs are randomly distri- 
ted, the probability of interference is small. This 
iy be better expressed reciprocally by saying that 
> probability of addition of A and B into C is great. 
the other end of the scale, A may be firing at satur- 
on level, i.e., impulses are conducted in’ as high a 
quency as the refractory time constant will allow. 
that case, it would be impossible for the other 
inch B to interpolate impulses, and the probability 
addition reaches zero. However, as pointed out 
‘lier, impulses in B may lengthen the refractory 
ae of J, and so block pulses from A. Thus, the prob- 
lity of addition may become negative, i.e., sub- 
ction can take place. Although this mechanism 
ms to lend itself quite naturally to formal analysis, 
sre does not appear to be a mathematical tool to 
ndle it conveniently ; especially, long chains of these 
actions, where C and another branch D converge 
junction I to form E, etc. may be difficult to manage. 
For this reason, it was decided to simulate the 
ternal spiral innervation by means of simple nerve 
alogs. HARMON in 1959 and in the preceding paper 
scribed such analogs. Most of the experiments to be 
sorted here were done with the earlier model, al- 
ough all results were checked with the later models 
well. Apart from scale factors, results were iden- 
al. The printed circuit cards on which these “‘neuro- 
mes”? (VAN BERGEIJK, 1960) are realized are easily 
sembled into modules with patch cord connections, 
ch unit incorporates primitive properties believed 
be characteristic of nerve fiber: threshold, temporal 
mmation, all-or-none response, firing rate related to 
citation intensity, absolute and relative refractory 
riods and transmission delay. 


Experiments 

Fig. 4 shows a diagram of the measuring set-up. 
ie ‘‘Basilar membrane’’ used here is the electrical 
alog of the cochlea built by Bogert (1951). This 
twork has a large number of taps, permitting obser- 
tion of the displacement pattern (here voltage 
ttern) in intervals corresponding to 0.2mm along 
> actual basilar membrane. 

The outputs of ten selected taps were amplified 
d rectified (frequencies of stimulation much higher 
an any frequency the neuromimes could respond to 
ectly were used); to protect the neuromimes from 
sakdown, the outputs from the rectifiers were 
1ited to 45 volts. The selection of the taps involved 
lecision on how much space to allow between them 
d in which “turn” of the network to place them. 

most of the experiments to be described, the 
tance between taps was equivalent to 2mm, going 
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from a point corresponding to 8 mm from the stapes 
to a point equivalent to 26 mm from the stapes, thus 
covering most of the basal and all of the second turn 


Divergent 
arbor 


Convergent 


arbor 
Fig. 2. Trees in the nervous system. Divergent arbors are usually axonal, 
convergent arbors commonly dendritic terminals 


Hair cells 


Fig. 3. Diagram to explain behavior of spiral nerves; see text 
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Fig. 4. Diagram of experimental set-up. The “basilar membrane” is the 
analog network of BoGERT (1951); the numbered triangles represent the 
neuromimes making up the simulated spiral nerve 


Amplifier 
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of the analog cochlea. This is considerably more than 
the ‘‘one-third of a turn’? length of the spiral fiber 
estimated by LormntsE DE N6. It turns out, however, 
that the results are qualitatively unaffected by vari- 
ations in the distribution, as we shall see shortly. 
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Let us consider one of the several experiments that 
were done. Suppose the nerve runs toward the apex, 
and its branches are ten in number, evenly spaced at 
2 mm intervals, as outlined above. Fig. 5 shows this 
situation; superposed on it is the envelope if a travel- 
ing wave of 1000 cycles. This envelope is proportional 
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Fig. 5. A typical experiment, as discussed in the text, consists of a “nerve” 

coursing toward the apex and spanning part of the first and the whole 

second turn of the analog cochlea. The solid and dashed curves represent 

the voltage patterns on the ‘“‘cochlea” for different intensities of input 
sine-wave. 


to the rectified voltage obtained from the taps. The 
output of a neuromime is a train of pulses; the fre- 
quency of the train is monotonically related to the 
input voltage. Since neuromime 1 in Fig. 5 is closest 
to the envelope maximum, it will be stimulated supra- 
liminally before any of the others as the intensity of 
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Fig. 6. Results from experiments such as pictured in Fig. 5. 
are averages from several experiments 


The curves 


the stimulus (1 KC sine wave) is increased. Let us 
assume that the solid-line envelope of Fig. 5 represents 
this condition ; only neuromime | is active at its lowest 
stable rate. As intensity is increased, neuromime 2 
becomes active at threshold (dashed envelope in Fig. 5). 
As intensity is further increased, all neuromimes in 
turn become activated, but by the time neuromime 10 
is producing some 100 pulses/sec., neuromime 1 is 
approaching saturation, i.e., it is firing close to its 
maximum frequency (225 pulses/sec.). Fig. 6 illus- 
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trates the process; input intensity in db is plotted 7 
output firing frequency in pulses per second. TI 
particular amplifier used did not deliver more tha 
45 db gain. Note that the curves do not run precise] 
parallel; the characteristics of the neuromimes sho 
individual variations; biological neurons presumab! 
show similar variability. Typically; however, a sing 
neuromime goes from threshold firing to saturatio 
firing in a 20—25 db range. This happens to be ju 
slightly more than the range covered by real nerve 
(Katsuki, Sumi, UCHIYAMA and WATANABE, 1958 
When we look at the output of the composite 10-brane 
fiber (here the output of +4 19), we see that the x 
sponse is graded over a much larger range. In othe 
words, the dynamic range of the system has been extendee 
In our model it is possible to look at intermediat 
locations of the “‘fiber’’ as well as at the last outpw 
Fig. 7 shows the results; the shorter the chain of sid 
branches, the steeper is the slope of the line relatin 
input intensity and output frequency, until of cours 
the limit is reached when there is only one sidebrane 
left. From this result, we may advance the suggestio 
that the dynamic range of a spiral nerve fiber is directl 
related to its number of side branches or to the numbe 
of sensory cells innervated by the fiber. Conversely ther 
it might be possible to estimate the number of side 
branches from the slope of the intensity-frequene 
curve. Of course, it is impossible to record fro 
different spots in the living spiral fiber; only the fin 
nerve (somewhere in the eighth nerve bundle) is ace 
sible. However, the basilar membrane has the con 
venient property that the traveling wave envelope r 
treats as the frequency of the tone is increased, thi 
rendering more and more sidebranches inactive. EH 
fectively, increasing the frequency shortens the actiy 
part of a spiral fiber, thus generating progressivel 
steeper slopes of the intensity-output curves. Hope 
fully, one may be able to record such data fror 
animals but unless the branches are rather far apart 
quantum steps corresponding to silencing of singl 
branches may not be noticeable. It should be possible 
however, to deduce the length of a spiral fiber h 
noting at which frequency the intensity-output slop 
does not decrease further (apical end of fiber) and @ 
which frequency no response at all can be obtaine 
(basal end of fiber). Since the displacement patter 
of the basilar membrane is known with some accuracy} 
the absolute position of the fiber can be estimatec 
In the experiment just discussed, the direction ¢ 
the fiber was toward the apex; experiments were als 
done with the fiber running to the base and wit 
“split” fibers. The most striking result of those e: 
periments was that the direction of the fiber does né 
matter, as far as the eventual output from the who! 
nerve fiber is concerned. In other words, the slope ¢ 
the intensity-output curve from neuromime 19 (or II 
in the “‘split”’ case) was the same for all configuration! 
as long as the sidebranches were connected to the sam 
taps on the analog basilar membrane. This leads to th 
suggestion that the dynamic range of the fiber is i 
variant under topological distortion of its course. The 
is, however, a difference in the way the curve changt 
as the number of branches is reduced. This is illu 
trated best by a comparison of Figs. 7, 8, and | 
Fig. 8 presents results from a fiber running toward I 
base, Fig. 9 is from a split fiber. Note that in Fig. 
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shorter chain data ‘‘peel off’? downward, as op- 
d to the upward peeling of Fig.7. Fig. 9, illus- 
ing the split fiber case, shows both modes. 

As mentioned earlier, most of the experiments were 
e over an unrealistically large segment of the 
log-cochlea; the reason for this was that the re- 
uses could be more clearly interpreted. Some ex- 
ments were done, however, with a chain of 19 
romimes extending from a spot corresponding to 
nm from the stapes to a position corresponding to 
) 19 mm from the stapes, or about half of the first 
1. The curves obtained are much smoother than 
ones obtained from the coarser distribution, but 
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’, Sample curves from an experiment as depicted in Fig. 5. Numbers 
refer to the neuromimes at whose output curves were obtained 


the slopes are steeper. We must, therefore, amend 
evious conclusion : the slope of the intensity-output 
ye decreases, that is, the dynamic range of the fiber 
eases, aS the number of sidebranches and the 
unt of space covered by the fiber increase. 

In view of the possible implications that these ex- 
ments may have for the theory of loudness recruit- 
it (see discussion), a series of experiments was 
ied out in which the analog spiral nerve was de- 
ed of active sidebranches by removing inputs from 
e arbitrarily chosen branches. In effect, this pro- 
2s a fiber with less branches, and we should expect 
slope of the input-output function to become 
per. The data wholly support this expectation; 
results of these ‘“‘random” truncation experiments 
practically indistinguishable from those obtained 
‘progressive’ truncation as exemplified by Figs. 7, 
ad 9. 

Again, because of possible implications, the ques- 
arose whether the voltage “ramp” resulting from 
assumption that the stimulus is proportional to the 
lacement of the basilar membrane (less amplitude 
the stapes than near the helicotrema) is really 
ntial to obtain the results described. In other 
1s, is it necessary that the effective thresholds of 
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the sidebranches are staggered, such that a new branch 
is brought into play with every few db rise in ex- 
citation? If it is true that the microphonic potential 
is the adequate stimulus for the nerves of the cochlea, 
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Fig. 8. As Fig. 7, but with “nerve” coursing toward base of cochlea. Same 
span as Figs. 5 and 7 
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Fig. 9. As Fig. 7, but with ‘‘split’’ fiber 


the evidence is good that in fact the stimulus does not 
follow the ramp-type increase, but is of about equal 
magnitude from one end of the cochlea to the other 
(Tasak1, Davis & Luaourx, 1952). In experiments 
with neuromimes it appeared that not only is the 
ramp-type excitation unessential, but smoother curves 
are obtained with “level” ‘stimulation (voltages at all 
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inputs equal), and the rule relating the steepness of 
slope of the input-output function with the number of 
branches emerges as before. 


Discussion 

The experiments described are based on the as- 
sumption that in some dendritic branches activity as 
indeed propagated in spikes, and not by some “analog 
process such as electrotonic spread of excitation. There 
is, of course, no direct evidence that the branches of 
the external spiral fibers do, in fact, conduct impulses. 
For the contrary point of view, viz., that excitation 
proceeds by graded potentials, no direct evidence is 
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Fig. 10. Averaged curves for several experiments identical to those in 
Fig. 6, but with “late model’’ neuromimes; note that the principal dif- 
ference between this and Fig. 6 is the magnitude of output frequencies 


available either, although Buttock (1959) suggests 
that the dominant mode of operation of dendrites in 
general is by graded and continuous potentials 
rather than by all-or-none im pulses. BuLiLocks 
suggestions, however, remain to be tested directly 
in the cochlea or other peripheral nerve endings. 
On the other hand, Eyzacurrre & KUFFLER (1955) 
find evidence which leads them to believe that in 
crayfish stretch receptor neurons, impulses may arise 
in the dendrites. Since no rational choice can be 
made at this time on the basis of available evidence, 
we must leave the question of dendritic signal propa- 


gation open and proceed on the assumptions stated 


until data accrue. 

With this caveat in mind we may examine some 
of the possible implications of the experiments des- 
cribed in this paper. The first fact that merits con- 
templation in the input—output behavior exhibited 
by these chains of artificial neurons is the remarkable 
independence of that behavior from the particular 
parameters of the neuromimes used. Whether we used 
the original 1959 neuromimes or the very latest models 
(maximum firing rate: 250 and 600 pps, respectively ; 
refractory time constant 4 msec and 2.7 msec; etc.), 
the shapes of the curves (after appropriate normali- 
zation of the coordinates) are as nearly identical as 
repeat experiments with the same neuromimes. Fig. 10 
is an example of an experiment similar to that of Fig. 6, 
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but with late-model neuromimes; the intensity ran 
covered is somewhat smaller (30 db vs. 45 db in Fig. | 
so only the initial portion of Fig. 6 should be used 4 
comparison. It would appear, therefore, that the | 
havior of a spiral nerve may be rather independe 
of the particular properties of the dendritic segmer 
making up the nerve. 

A second fact worthy of note is the behavior of s 
called “‘split” fibers, as exemplified by Fig. 9. Whe 
as our usual neuromime trees are binary branchi 
trees which have the restriction that after each dec 
sation only one of the resulting branches can bifurea 
again, the split fiber is, at least at the first bifurcatic 
relieved of this restriction. Nonetheless, its behavyi 
is not different from that of the other fibers. TI] 
raises an intriguing question: is the behavior describ 
in this paper an exclusive property of the spiral i 
nervation of the ear, or will any dendritic tree beha 
similarly? It is easy to see that the spiral nervy 
having to branch in what is practically a one-dim 
sional space, could not very well be built any ot 
way. But skin nerves have no such restrictions to ¢ 
with, and their dendrites look more like the convergs 
arbor of Fig. 2. There are data by von BExKksy (198 
on the subjective magnitude (“loudness”) of stim’ 
on the skin, which demonstrate that in dense 
nervated areas (e.g., edge of lip) the growth of sens 
tion vs. intensity has a slope much more gradual thi 
in sparsely innervated areas (e.g., cheek), where se 
sation magnitude rises much faster. Also, in anoth 
paper von BiKisy (1958) demonstrates that stim 
lation by a sharp point produces steeper slopes thi 
stimulation by a large disk on the same skin pate 
If it be true that total neuron output is proportion 
to sensation magnitude or loudness (see, for instant 
FLETCHER, 1953), then von B&Késy‘s results can 
interpreted on the basis of our experiments. If den 
innervation is present, many sidebranches of a de 
dritic tree will be stimulated simultaneously by 
stimulus of prescribed spatial extent. The sai 
stimulus in a sparsely innervated area will active 
less branches, and, in accordance with the princij 
proposed here, the rise in output from the latter I 
a steeper slope than that from the former case. JT 
same argument holds for stimuli of different spat 
extent operating on a prescribed patch of skin: a poil 
like stimulus activates less branches of the senst 
trees than a large-area stimulus. 4 

An additional piece of evidence bears directly 
the cochlea. In 1960 Butter, Konisuy & FERNAND 
published the finding that when the cochlea of 1 
guinea pig is cooled below normal body temperatu 
the steepness of the input-output function of the 
response increases. Since they found a correspond 
decrease in microphonic potential, we might interp 
their findings in the following way. As temperati 
decreases in the cochlea, progressively more hair ¢ 
become inactivated and incapable of generating mic 
phonic potential. The branches of spiral nerves C 
necting to these inactivated cells are then effectiv 
eliminated, and the slope of the input-output functi 
must increase according to our model. Whether I 
cells in fact “drop out” progressively (rather tl 
decrease in output uniformly) cannot be ascertai 
from the results of Burner et al. Because of this 
certainty, their results on the slope of the N, inp 
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itput function cannot be construed as direct proof 
r our hypothesis, but they are at least suggestive of 
; validity. 

This brings up a final bit of speculation: if the 
chlea is damaged by trauma or pathological pro- 
sses, such that some of the hair cells are destroyed 
id, consequently, the spiral nerve branches innervat- 
g them become inoperative, the innervation density 

the cochlea is effectively decreased, while the 
imulus-extent (determined solely by the mechanical 
‘operties of the cochlear partition) remains the same. 
e would then expect steeper slopes in the input- 
itput relationship, as exemplified by Fig. 8. This 
lenomenon is known in the otological literature as 
loudness recruitment’’; in cases of so-called peri- 
eral nerve-deafness, a threshold shift associated 
ith a steep rise in the loudness curve and diminished 
mamic range is observed. Typical curves resemble 
ose of Fig. 8 remarkably well. Loudness recruitment 
is been definitely associated with pathological 
anges in the cochlear end-organs such as occur in 
ENIERE’S disease (labyrinthine hydrops) (HALLPIKE 

Hoop, 1959). Present-day theories attempting to 


plain loudness recruitment generally follow WEVER’S ° 


ggestion (1949), that the phenomenon is due to the 
mination of a limited number of receptors which 
rmally respond to stimuli of near-threshold intensity. 
ALLPIKE & Hoop reject this notion on the basis of the 
ct that the histopathological changes extend along 
e whole length of the organ of Corti in MinrERE’s 
sease. Also, the “dual excitation” theory of Davis 
950) suggesting that the lower reaches of the loud- 
‘SS curve are due to the outer hair cells, while the 
yper part is due to the (presumably less sensitive) 
ner hair cells, cannot explain loudness recruitment, 
cause HaLLPrKE and Hoop find no preferential de- 
ruction of outer hair cells and preservation of inner 
ir cells in their cases of MENIERE’S disease. 


Another difficulty arises in the explanation of the 
ct that in late chronic cases of MENIERE’S disease 
cruitment diminishes and sometimes disappears al- 
gether while the hearing loss (threshold shift) re- 
ains (HatLerKE & Hoop, 1959; Kos, 1955). Also, 
e hair cell damage persists, and no regeneration 
ems to take place. With the prevalent theories this 
ct is very hard to account for, but with the spiral 
rve hypothesis the explanation is relatively straight- 
rward. We need merely assume that. a spiral dendrite 
Il degenerate altogether when a certain critical pro- 
rtion of the hair cells it innervates has been de- 
royed. (That nerve degeneration follows extensive 
ir cell damage is well known; see, for instance, 
EVER 1949.) Once a whole nerve fiber with all its 
anches is dead, the case reduces to that of eighth 


nerve interruption (as with tumors), for which loud- 
ness recruitment is known to be absent. Any residual 
loudness recruitment in late chronic patients can be 
ascribed to nerves for which the critical proportion of 
damaged hair cells has not been reached. The spiral 
nerve hypothesis thus appears to explain the main 
facts known about loudness recruitment. In addition 
it suggests a relation of auditory sensations with 
several other modalities, such as skin sensitivity and 
brightness perception in the eye. It is even possible, 
perhaps, to view the different subjective magnitude 
curves that have been obtained for many sense modal- 
ities by Stevens (1960) and the power functions by 
which they can be defined, as descriptions of the in- 
nervation densities subserving those sense modalities. 
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Studies with Artificial Neurons, III: Mechanisms of Flicker-Fusion 
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Summary. 1. A simple model is described which establishes 
relationship between physiological and psychophysical 
Aker-fusion data. The three components of the model are 
transducer, a filter and a flicker-detector. The model is 
isistent with the view that fusion is purely retinal. 


2. An electronic analog is used to realize the model. Its 
essential elements are a source of generator potential, a low- 
pass filter, and a simulated ganglion cell. 

3. The model was originally designed to reproduce the 
psychophysical results obtained by DE Lanen. Special 
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importance is attached to the envelope of his curves; the 
model reproduces this envelope. His low-intensity results 
are duplicated accurately, while the high-intensity, high- 
frequency data are derived somewhat less accurately. The 
high-intensity low-frequency data are attributed to a mecha- 
nism not included in the model. 

4, In the simulation of physiological data obtained by 
Enrotu, close resemblance to the firing characteristics of 
retinal ganglia in cat is shown by the model. Firing occurs for 
bursts lasting for at most half the period of the alternating 
stimulus, the number of spikes per burst diminishing to unity 
as “fusion” is approached. 

5. The phase lags and latencies of responses in the model 
satisfy neurophysiological evidence. Both off-latency and 
inhibition-latency are satisfactorily reproduced. 

6. The model has been used to simulate two-component 
flicker data. The ‘“‘flicker-detector”’ employed leads to results 
very similar to those obtained psychophysically. The phase 
characteristics of the assumed filter agree less well. 


Introduction 


There exists no model of adequate generality for 
the apparently simple phenomenon of flicker-fusion. 
The inability of the human visual system to follow the 
changes in intensity of a flickering light has been 
voluminously documented for over 200 years. Yet, as 
Lanpis (1953) said in his monumental bibliography, 
“Even such a simple point as whether the flicker- 
fusion threshold is dependent on retinal functional 
limitations or on limitations imposed by the central 
nervous system has never been clearly answered.”’ 


We shall describe a model of the flicker-fusion 
mechanism which is in close agreement with both 
physiological and psychophysical evidence. It is a 
“single element”’ model, i.e., one in which interactions 
between neighboring retinal elements are ignored. A 
selection of particularly comprehensive data as the 
basis for the design of the model justifies its presen- 
tation in a field where so many already exist (Ivzs, 
1922b; Hecut & VerRvp, 1933; pE Lanan, 1952; 
Ke tty, 1960; pE Lanes, 1961). 

Although we make no attempt to resolve the 
question of peripheral vs central fusion, (the model is 
consistent with either point of view), some bias for 
retinal fusion will be apparent. The model has been 
designed to show readily the correspondence between 
its components and retinal components. It is con- 
sistent with physiological evidence which implies the 
possibility of purely retinal fusion (GRanit & THER- 
MAN, 1935; Harting, 1938; Enrotu, 1952; Svarrt- 
CHIN, 1956). 

Purely analytical or mathematical models are not 
readily applicable to complex, nonlinear systems (e.g., 
neural structures). The detailed behavior of such 
abstractions may be difficult to predict. Furthermore, 
unwelcome constraints and simplifications often be- 
come necessary. In such cases a physical model which 
can be used to yield experimental data is often useful. 
Employed literally as an analog computer, a physical 
model can be instructive, readily manipulated and 
stimulating. 

We have built an electrical circuit for this purpose 
and have investigated the correspondence between 
components of the circuit and some of those in the 
physiological system. Various signals which appear at 
different places in the model’s “visual pathway” have 
been compared with signals in the physiological visual 
pathway to test the relevance of the model. The out- 
put response of the circuit is similar to that of a 
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retinal ganglion cell; this has been accomplished. by 
using an electronic analog of a generalized neuror 
(Harmon, 1961). 

The design criteria for a model of flicker-fusion are 
not easily stated. There has been no apparent common 
basis on which to evaluate psychophysical data derived 
from the great variety of classical stimulus presen. 
tations such as rectangular waves of varying light. 
dark ratio, triangular waves, repeated brief flashes and 
the like (e.g., Ives, 1922a; Ross, 1938; Brown & 
ForsytuH, 1959; Barrtey & NeExson, 1961). How- 
ever, in recent years flicker-fusion has been investi. 
gated by new and revealing techniques. Particularly 
important studies are those by pp Lancs (1952, 1954, 
1958), and by Enroru (1952). The new information, 
no less significant than Talbot’s law or the Ferry- 
Porter law, has received less attention in the literature 
than it deserves. | 

Dr LAnGe’s results show that in the human visual 
system, response is rapidly attenuated with rising 
frequency for sine waves above 10 c/s. Therefore, for 
these frequencies the fundamental component of any 
stimulus waveform is the most significant; higher 


- harmonic components are progressively less effective. 


By considering the stimulus as a composite of 
sinusoidal components and by taking into account the 
attenuation observed by DE LaNe@E, a unified under- 
standing of much of the previous work is made possible 
(pE Lanes, 1958; Levinson, 1959; Kexty, 1961). We 
thus feel justified in considering DE LANGE’S research 
as representative of a large body of flicker-fusion 
psychophysics. Consequently our model has been 
designed to reproduce the most significant aspects of 
DE LANGE’s data. 

Bearing closely on DE LANGE’s psychophysical 
results are the physiological findings of ENnRotu, al- 
though the connection may not be immediately obvious. 
Enrorn’s work supplies data on the latencies of cat 
retinal ganglion responses to flicker. These data 
complement the attenuation properties mentioned 
above. Understanding the relationship between 
latency and attenuation is critically important because 
no explanation of the fusion mechanism which includes 
one and ignores the other is complete. The model to 
be described accounts for both the observed latencies 
and the attenuation characteristics by a relatively 
simple system in which each property implies the 
other. “a 

An examination of the characteristics of the model 
which were required by physiological considerations 
led to the prediction of new psychophysical results 
This prediction was then used to test the validity oi 
the model. a 


Psychophysical considerations 


Dr Laner’s advance followed from the realization 
that the light stimulus must be controlled for two para: 
meters, average (steady-state) and alternating illumi 
nation. In traditional flicker presentations the ampli 
tudes of the average and alternating components 0} 
the stimulus vary at once and are not separately com 
trolled, e.g., where the light-dark ratio is used as é 
parameter. Since it is well known that changes i 
average illumination modify the eye’s adaptation, th 
absence of proper control over the stimulus was & 
serious shortcoming. Dm Lanar’s flicker stimulus wai 
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tained by sinusoidal modulation of an otherwise 
eady light. Since both the average illumination and 
ie depth of modulation were separately variable, he 
ad independent control of the two stimulus com- 
onents. The presentations were foveal, and the 
minances were in the photopic range. 

Fig. 1 shows some typical results replotted from 
E LANGE (1958). We retain pz LaNGx’s convention 
[ plotting the ordinates with increasing intensity 
ownwards so as to reveal the resemblance of the 
irves to attenuation characteristics of electronic 
ystems. The curves plot the peak amplitude of the 
nusoidal modulation as a function of its frequency 
f fusion threshold. Each curve represents a different 
verage retinal illuminance J on which the alternating 
omponent 7) was superimposed. Above 10 ¢/s, i) must 
e increased to achieve higher fusion frequencies. 

De LANGE customarily plotted not the absolute 
iodulation amplitude (as shown here) but its per- 
entage of the average illuminance. We have replotted 
is results in order to reveal the fact that all the curves 
ave a common envelope, as indicated by the dashes. 

We attach considerable importance to this en- 
elope. Its equation is simple, having the form of the 
ell known Ferry-Porter law which relates fusion 
equency to illuminance, 

f=A log i,+ B. 
the envelope sets a bound upon the amplitude- 
eequency range within which flicker may be ob- 
arved, regardless of average illuminance. This sug- 
ests the existence of a specific visual mechanism of 
mited high-frequency response. This mechanism is 
mulated in our model by a low-pass filter. 

The additional loss of flicker sensitivity represented 
y the dips in the high-intensity curves at low frequen- 
ies is a function of average illuminance J. We feel 
hat this should be attributed to the action of an 
dditional mechanism, one not included in the present 
1odel!. The requirement for some other mechanism 
; also suggested by the common subjective experience 
hat the setting of flicker-fusion threshold is a different 
ask at low and at high frequencies. This subjective 
mpression is reinforced by the findings of KELLy 
1959) that modulation amplitudes for fusion at low 
equencies depend markedly upon the nature of the 
arround of the test spot, but that at high frequencies 
he surround has relatively little influence. Thus, 
hile a single-element model may account for all the 
igh-frequeny data, it cannot lead to all the low- 
equency data. To this extent then the present model 
spresents a compromise. It will be seen to account 
dequately for the envelope of DE LANG#’s results and 
yr the two low-intensity curves as well. 

Thus far we have considered the attenuation-with- 
‘equency characteristics of the visual system, ob- 
srving with pe Lance that such characteristics are 
roduced by a low-pass filter. We still require a 
snsing element after the filter. It seems reasonable 
) assume that this element reacts only to a change in 
Iter output, regardless of filter input. That is, we 
ostulate that there is a particular site in the visual 
ystem where there is constant physiological response 


1 Such a mechanism might operate by frequency- and 
tensity-dependent feedback. The sort of feedback provided 
y lateral inhibition or efferent innervation could account for 
ich action. 


Joun Leyrnson and Leon D. Harmon: Studies with Artificial Neurons. III 


109 


at fusion threshold. The requisite sensing element 
following the filter would be a nonlinear threshold 
mechanism. This is a “‘flicker-detector’’, its functional 
analog providing another component of the model. 
The physiological evidence for flicker detection by 
retinal ganglion cells is described in the following 
section. 


Physiological Considerations 


EnrotH (1952) recorded. spikes at the retinal 
ganglia of cats and demonstrated the relationships 


T=0375 & 1.0 
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S 


=— Modulation amplitude (Trolands) 


Flicker frequency in c/s 


Fig. 1. “‘Flicker attenuation characteristics’” (DE LANGE, 1958). Intensity 

of light modulation as a function of critical flicker frequency at constant 

average illuminance, I. Ordinates represent the peak amplitude 7 of the 

sinusoidal modulation required for fusion threshold. Dashes indicate 
envelope to all curves 


between flicker frequency and bursts of spikes in single 
cells. Fig..2 reproduces one of Enroru’s recordings. 

Light is recorded in the upper traces, on and off 
respectively being represented by upward and down- 
ward displacements. Neural action potentials are 
shown in the lower traces. The ganglion cell from 
which the recording is taken is of the off responding 
type; a burst of spikes occurs in response to each 
cessation of illumination. The number of spikes in each 
burst diminishes roughly monotonically as the stimulus 
frequency is increased. The duration of spike burst is 
always less than half the period of the repetitive 
stimulus. 

The latency between light off and neural response 
appears to be approximately constant with frequency. 
Note, however, that at the point that the ganglion 
firing fails to be synchronous with the stimulus (arrow 
in figure), the latency of response extends over more 
than one complete stimulus cycle. Delays of this 
magnitude are usually concomitants of steep slopes 
in the attenuation characteristics of simple (linear) 
filter systems, Thus these physiological data also 
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support the hypothesis of a low-pass filter which was 
implied by psychophysical findings. Obviously, more 
complex (nonlinear) filters can be conceived which 
produce similar results. The linear low-pass filter 
seems to be the simplest one which satisfies our require- 
ments; parsimony inclines us to explore its implications 
before investigating more complicated filters. 

Other evidence for retinal filtering has been ob- 
tained from the ommatidium of Limulus (HARTLINE, 


Sapp gaat ng i Yer 
a ee et eS 


Fig. 2. Response of cat retinal ganglion cell to flickering light (ENROTH, ‘ 

lines—square-wave light stimulus of increasing frequency. Bottom lines—spike output 

recorded in ganglion cell. Unit is of the off responding type; off-latencies are indicated 
by dotted lines. “‘Fusion”’ is said to occur at arrow, line 3, where synchronized 


response fails 


H. K., Mitier, W. H. & Raruirr, F., personal com- 
munication). For a square-wave light stimulus at very 
low frequencies, a ‘‘slow potential” is observed which 
has approximately the waveform of the stimulus. 
However, for stimulus frequencies above about 5 ¢/s 
the slow potential becomes sinusoidal. Similar action 
has been noted by SvanricHrn (1956) in the retina of 
sunfish (Lepomis spp.). 


Low-pass 


Filter Defector 


Transducer 


DIL ARAS ee 


Fig. 3. Functional representation of three-component model, Transducer 

converts square-wave light stimulus into square-wave physiological signal; 

low-pass filter converts square waves into sinusoids; detector sets fusion 
threshold and responds with spike output to filtered signal 


Enrotu’s criterion for fusion is based on the 
termination of synchronized response. Fusion is said 
to occur at that stimulus frequency for which the 
number of ganglion spikes per burst diminishes to 
unity and beyond which erratic or no firing is observed 
(arrow in Fig. 2). The ganglion cell thus appears to 
play the role of flicker-detector. This is the threshold 
device mentioned above which was postulated to 
follow the filter mechanism. 


The Model 


Fig. 3 shows the “‘single element’? model. It has 
three components. First, a transducer accepts a light 
signal and produces a signal of some other nature. 
A filter which possesses the frequency dependence 
observed by DE Lance follows. Finally, a threshold 
device (detector) operates with the firing character- 
istics found by Enrorn. 
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The physical realization of this model incorporates 


the attenuation with frequency, the latency, and the 


ganglion-cell firing characteristics which have beer 
described. A transducer was not included for the 
reason that it is not functionally important for thi 
model whether the initial transduction in the photo. 
receptor is chemical, ionic or electronic. It is sufficient 
to represent it by an arbitrary parameter which ulti 
mately produces the equivalent slow potential. Conse. 
quently an electrical voltage is used te 

represent the light input. It is applied 

a: directly to the low-pass filter. 
The filter is linear; phase and atte. 

nuation are related simply (see Appendix) 
It possesses attenuation and delay cha 
racteristics such that its output is sinus- 
oidal over most of the frequency range 
of interest, irrespective of whether the 
input waveform. is sinusoidal, square. 
triangular or the like. Five vitersiaga 


_— 
is 


j 


resistance-capacitance low-pass filter stage 
are used. The attenuation rate thus appro- 
aches 1.5 log units per octave—an 7 
mediate value which leads to the bes 
over-all fit to pm Lanen’s data. The filter 
cutoff frequency is 10 c/s. The delays introduced by 
this filter are of the required magnitudes, as will be 
discussed. below. 
The flicker-detector is represented by an electronié 
analog of a neuron (‘‘neuromime’’) of the type des- 
cribed by Harmon (1961). To satisfy ENRoTH’ 
results it must be arranged to produce a burst of spikes 
for each half cycle of the stimulus, the number o 
spikes per burst diminishing with decreasing exci- 
tation. Furthermore, as may be seen in Fig. 2, the 
latency per stimulus cycle must increase with fre- 
quency, and the latency from stimulus off to response 
must be less than that from stimulus on to terminatior 
of response. : z 
Like the natural neuron, the neuromime responds 
only to unidirectional (cathodal) stimulus and fires 
only if its threshold is exceeded. Hence for a sinusoid- 
ally shaped stimulus whose average value is zero, the 
neuromime behaves as a half-wave rectifier. Since in 
practice its threshold is not exactly zero, but is arbit 
rarily set by its internal circuitry!, excitation typically 
occurs during less than half of each cycle. e 
Excitation time and duration depend upon the 
amplitude of the sinusoid developed by the filter. As 
a stimulus is increased in frequency or decreased in 
amplitude, the excitation available to the neuromimeé 
is both briefer and less intense. In a typical flickel 
experiment, stimulus amplitude is held constant as 
frequency is increased, This is reflected in the neuro 
mime’s firing as schematized in Fig. 4. _ 
Three cases are shown. At an input frequency 0 

10 c/s, the filter develops a relatively large-amplitude 
sinusoid which considerably exceeds threshold an¢ 
which evokes a burst of spikes from the neuromime 
The delay, indicated by the dashed line between squar' 
wave and sinusoid, is somewhat longer than half th 
stimulus period. 7 
; If the up-going direction is taken as on for th 
stimulus, then the response illustrated may be arbit 


1952). Top 


1 The results would have 


b i i a 
some other threshold value. een very little affected by usin 
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y taken for the off half cycles to correspond with 
results shown in Fig. 2. 

\t 15 c/s the same input amplitude produces an 
nuated filter output which is manifested in the 
romime’s output by fewer spikes per burst, decrea- 
duration of burst and increased relative latency. 
> absolute value of latency is little changed; how- 
*, at this increased frequency it now represents 
ly one full period of delay relative to thestimulus.) 
Finally, at 25 c/s the excitation available to the 
romime just reaches threshold, evoking one spike 
ra delay of approximately one stimulus cycle. 
t beyond this point firing may be erratic (because 
ise in the system). At higher frequencies, given 
same stimulus input amplitude, threshold is not 
seded, and no firing occurs. Given a larger stimulus 
litude, firing could be evoked beyond 25 c/s. 

The latencies in this model are made up of two 
pendent components, the filter delay being the 
er one. An analysis of this action and circuit 
1ils of the model appear in the Appendix. 


Experimental Results 


1. Simulation of psychophysical data. The envelope 
the flicker-fusion ‘‘attenuation characteristics’ of 
LANGE is easily duplicated. A sinusoidal stimulus 
bage was employed in order to be consistent with 
LANGE’s procedure, although square waves would 
e yielded identical results owing to the action of 
filter (exept at very low frequencies). 

In order to obtain the required characteristics, 
nts of ‘‘fusion” must be established. To do this we 
pted Enrotn’s fusion criterion. For constant 
nulus amplitude, frequency was increased until the 
nber of neuromime spikes per burst diminished to 
ty and synchronous firing ceased. At this point 
ion was declared and the frequency noted. These 
nts are shown in Fig. 5, superimposed upon the 
LANGE curves which appeared in Fig. 1. 

The dots represent measured points. The psycho- 
ysical data cover a wider stimulus range than we 
e able to employ with the model because of the 
iculty of obtaining and handling the required 
rating voltage (a range of 50,000: 1). 

We may extrapolate our results analytically 
ording to the equation 


E=0.0177 [1 + (f/10)?]>? 


ere EH is the peak amplitude of the input voltage 
the fusion frequency /. This expression applies to 
-stage filter (see Appendix) with parameters deter- 
1ed from our experimental data. Circles in the 
ire represent the extrapolated points. 

It will be seen that the model’s characteristic 
ve follows the low-intensity data and is roughly 
envelope of the rest of pE LANnce’s results. The 
to the low-intensity data would be better with a 
er cutoff frequency of 11.3 c/s instead of 10.0 c/s, 
10ugh to the high-intensity data it would be worse. 
2. Simulation of physiological data. The latency 
| firing characteristics required by ENROTH’S find- 
s are accurately reproduced by the model. Typical 
ponses are illustrated in Fig. 6. Input square-wave 
plitude was held constant while the frequency was 
ied from 10 c/s to slightly over 25 c/s. The number 
output spikes per burst diminishes monotonically 


with increasing frequency until at 21 c/s there is one 
spike for each off stimulus. This continues until at 
24.5 c/s occasional spikes drop out. At 25.5 c/s only 
a few spikes are observed. By 26 c/s there is no further 
output; the excitation available from the filter lies 


/0c/s /5c/s 25¢/s 
NS we 
| Threshold. 
\ ~ 
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Fig. 4. Schematized attenuation and phase lag action of filter and con- 

sequent neuromime response. As input amplitude is held constant and 

frequency is increased, available excitation to neuromime is diminished. 

Latency (short dashes) increases on a per cycle basis. Spike production 

occurs during time that excitation exceeds threshold. Spikes per burst 
diminish in number as excitation decreases 


well below the neuromime’s threshold from this point 
on. Note the similarities to the physiological results 
of Fig. 2. 

Enrortu describes two parameters of latency. For 
the off receptors under consideration, the “‘off- 
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Fig. 5. Flicker attenuation characteristics of Fig. 1 with data from model 
superimposed. Dots—measured values; circles—extrapolated values 


latency”’ is defined as the interval between the stim- 
ulus turn-off and the initiation of a ganglion cell out- 
put burst. “‘Inhibition-latency” is defined as the 
interval between the subsequent turn-on of the 
stimulus and the termination of the burst. The curves 
of Fig. 7 represent theoretical off-latency (A) and 
inhibition-latency (B) for the model (see Appendix for 
derivation). 
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The points associated with each curve are measured 
responses of the model. Off-latency can be measured 
directly, of course, by noting the time at which firing 
begins. It is not possible to verify the theoretical 
inhibition-latency precisely since the last spike in a 
burst is not necessarily coincident with the threshold 
crossing of the sinusoidal excitation. Consequently, 
the points corresponding to inhibition-latency (circles) 
are approximations obtained by extrapolation. 

The action of a circuit used to obtain adaptation 
(see Appendix) introduces additional discrepancy 
between measured and theoretical inhibition-latencies. 


20 c/s Zlc/s t 
“ ° 
Fusion” 
Fig. 6. Square-wave stimulus, and neuromime response as a function of frequency at constant amplitude. 
Fig. 2. 


ceases past 24.5 c/s. 


This circuit deforms the half-sine wave into a shape 
which provides a fast rising and slowly decaying 
voltage. The resultant firing frequency has a high 
initial rate and then slowly diminishes. 

The shapes of the curves of Fig. 7 are similar to 
some of those given by Enrotu. The variability 
among the units she tested, however, does not allow 
extremely close comparisons to be made. Note, how- 
ever, that at any frequency the inhibition-latency is 
shorter than the off-latency, in accord with the physio- 
logical data; i.e., firing always occurs for less than a 
half cycle. ENRorH points out that at fusion (off- 
latency) —(inhibition latency) = flash duration =dark 
period. The ‘fusion’? frequency in the model ex- 
periment described above was about 24.5 c/s. From 
Fig. 7 it is seen that at this frequency the off-latency 
is approximately 47.5 msec, and the inhibition-latency 
is about 28 msec. The difference of 19.5 msec cor- 
responds closely to the half period (flash duration) of 
20.4 msec. 

3. A test of the model. Consideration of our theo- 
retical model suggested a new technique for psycho- 
physical investigation of flicker-fusion. Thus far, we 
have confined our attention to simulation of the 
amplitude and the delay characteristics of the visual 
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system for threshold flicker. If the visual system h 
a ‘‘flicker-detector”’ as postulated, then we might al: 
expect it to respond differently to different wav 
forms. Such waveform sensitivity, if found psych 
physically, would be of use in further validating tl 
model. 

To test for waveform sensitivity one cannot simp) 
modulate the light with a wide variety of comple 
waveforms. The frequency dependence of the visu, 
system insures that the higher harmonic componen 
of the stimulus (which generate the complexity of tl 
waveforms) are severely attenuated. Thus, in tern 


25.5c/s 
7ime=50 msec fp Div. 


Compare with physiological results 


Spikes occur in regular bursts for each half cycle of stimulus, decreasing in number per burst as frequency is increased. Regular firil 
After 26c¢/s no further output could be obtained 


of our model, most waveforms are reduced to tk 
fundamental sinusoid by the time they reach tk 
flicker-detector. Consequently, in order to investigat 
waveform sensitivity at the detector, appropriat 
stimulus compensation must be supplied. Details ¢ 
the method have been described by Luvryson (1960 


Briefly, the procedure consists of modulating 
stimulus light by a waveform which is the sum of tw 
sinusoids, a fundamental and its second harmoni 
Compensation is achieved by allowing a subject to s 
the amplitude of each component separately to fusi¢ 
threshold. Thus, the two stimulus components produ 
equal “sensation levels”. However, the stimul 
amplitudes are generally quite different. For exampl 
at frequencies of 10 and 20c/s, the fundament 
stimulus amplitude is only one-tenth that of tl 
harmonic. 

When the light is modulated by the sum of the t¥ 
adjusted components, flicker is again apparent. TI 
reason for this is that the peak amplitude of # 
combined waveform is greater than that of eith 
component. This may be seen by referring to Fig. 
The fundamental and the second harmonic are shov 
with | equal amplitudes to represent the presume 
condition at the flicker-detector. Their combint 
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veform is shown in the lower trace. It varies with 
relative phase £, as defined in the figure. £ is not 
ectly measurable, of course, but will differ by some 
stant amount from the relative phase « between 


§ 


YG 


Latency in msec 


"0 12.5 1S 175 20 20.8 705) 
Frequency in c/s 


7. Delay as a function of frequency. A—‘Off-latency’’, the interval 
veen stimulus turn-off and initiation of response. B—‘ Inhibition- 
ney’’, the interval between stimulus turn-on and cessation of response. 

Curves are theoretical; points show measured values 


> stimulus components. The constant difference 
sween a and f is contributed by the filter. 

Since the combined-modulation amplitude exceeds 
» threshold of the flicker-detector, a reduction in 
mulus amplitude is required to re-establish fusion. 


| 
| 
| 


| Relative 
phase 


-f-->| 


Relative amplitude 


8. Two-component waveform (C) derived from fundamental (A) and 

ul amplitude second harmonic (B). The form shown is the sum of A 

B for the indicated relative phase, 8, between A and B. Phase ss given 
in degrees of the 224 harmonic cycle 


rther, the reduction required will vary with $. This 
yendence may be understood from Fig. 9. 

‘All four waveforms result from combining two 
jalamplitude sinusoids which differ in frequency by 
actor of two. Each waveform arises from a different 
ue of f, as indicated. These quite dissimilar wave- 
ms result from stimulus waveforms which differ 
y little since the light modulation is predominantly 
ond harmonic (due to the low amplitude of funda- 
ntal which is required). However, it is just the 


small contribution of the fundamental which so mar- 
kedly modifies the waveform at the detector. 

A detector might discriminate between these wave- 
forms on the basis of any one or more of several para- 
meters. For example, the 0° and 180° waveforms have 
the greatest total excursion (peak-to-peak values) 
while the 90° and 270° waveforms have the greatest 
positive and negative (peak) excursions, respectively. 
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Fig. 9. Two-component waveforms for four particularly significant values 
of relative phase 


A peak-to-peak detector would exhibit maximum sen- 
sitivity to either member of the first pair. A peak 
detector would be most sensitive to one or the other 
of the second pair (but not to both), depending on its 
preferred polarity. Thus, a peak-to-peak detector 
would exhibit two maxima in each 360°, while a peak 
detector would show only one. 

The results of the psychophysical experiment per- 
formed to test for waveform sensitivity are given in the 
upper trace (A) of Fig. 10. The required fractional 
reduction of amplitude is plotted as a function of 
relative phase «. The frequencies employed were 10 
and 20 c/s. Averaged data for five observers are shown. 
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Fractional reduction of combined waveform 


0° 90° 180° 270° ~—— 360° 450° 
Relative phase c 

Fig. 10. Flicker sensitivity as a function of waveform. Two sinusoidal 
modulations, 10 and 20 ¢/s, are individually set to fusion threshold. When 
these two components are combined, their amplitudes must be reduced 
to re-establish fusion threshold. Ordinate values represent the required 
proportional reduction as a function of the relative phase « between the 
sinusoids. A—Psychophysical results averaged over five subjects. B—Data 
obtained from electronic model 


It is clear that phase sensitivity exists. Further, 
since the sensitivity maxima (dips in curve) occur 
every 360° and not every 180°, the detector behaves 
like a peak detector. 

This experiment was duplicated with the electronic 
model. Frequencies of 10 and 20 ¢/s were again em- 
ployed. The voltage at each frequency was independ- 
ently set to fusion threshold as previously defined. 
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The two voltages were then added at various relative 
phases. As in the psychophysical experiment, this 
brought response above fusion threshold. The am pli- 
tude of the combined waveform was reduced until 
fusion threshold was re-established. The fractional 
reduction is plotted in curve B. 
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fusion threshold lies at that frequency at which aj 
ganglia cease firing synchronously. It seems mor 
reasonable to assume that flicker appears to fuse wher 
some percentage of ganglia cease to follow. Inasmudl 
as EnrotH demonstrated a wide spread in the distri 
bution of thresholds among a population of ganglior 
cells, we assume that a 
psychophysical fusio1 

~~ threshold some gangli 
will still be firing severa 
spikes per half cycle 
some will be in ENROTH 
fusion condition, an 
some will no longer bi 


R=/k& 
C=/5 pF 


neuron (N). 


The most significant similarity between the two 
curves is that each exhibits only one sensitivity maxi- 
mum in 360° of relative phase. The qualitatively good 
agreement of the two curves provides further evidence 
for the appropriateness of the model. 


2 


BSOWND AF w 


Relative input amplitude 
for constant output 
t% 
S 


VSS s 


/ Gin Te OO eno 


Frequency in c/s 


20 30 


Fig. 12. Filter attenuation characteristic. The five independent stages of 

the low-pass filter have a combined cutoff frequency of 10 c/s. Response 

falls off rapidly with increasing frequency, approaching 1.5log units/ 

octave. Response is indicated by plotting downward the increasing input 
amplitude required for constant output 


It is difficult to set a criterion for quantitative 
agreement. The ordinates of the two curves agree only 
approximately. Also, the precise phase matching of 
maxima and minima is accidental; further consider- 
ation showed that such precision is hardly to be 
expected. This point is discussed below. 


Discussion 
With reference to ENrorn’s criterion for fusion, it 
. . 2 
should not necessarily be inferred that the animal’s 


Fig. 11. Schematic of electronic model. Square-wave voltage stimulus, applied to five independent low-pass 
filter stages, emerges as a sinusoidal voltage. The filter stages are isolated by unity-gain amplifiers (A,—A,). 
After final amplification (A,) the signal is shaped and introduced as an excitatory voltage to a simulated 
The final response is a series of spikes 


following the stimulus a 
all.. The “fusion” dat: 
derived from our mode 
represent those cells i 
Enrortu’s fusion con 
dition. 4 

If the information pro 
| duced by the ganglia ; 
transmitted as such, the 
the only role to be play 
by more central mech; 
nisms is the setting of | 
fusion criterion on the basis of the percentage ¢ 
ganglia still firing. Variations in this criterion maj 
occur but are not of interest at the moment. 

Looking at fusion in this light resolves the apparen 
conflict arising from evidence that ERG and cortica 


responses to flicker may be present even though th 
subject reports fusion (VAN DER TwEEL, L. H., pet 
sonal communication; LinpsLEy, 1960). 

In the initial stages of developing our model w 
considered only the filter characteristics required to fi 
DE LANGE®’s results. It was subsequently noted the 
the delays inherent in the proposed filter were of th 
order of magnitude of the ganglion response latencie¢ 
found by Enrotu. By applying her physiological 
derived definition of fusion to a generalized model ¢ 
a neuron, the physiological and the psychophysie 
requirements were satisfied simultaneously. 

These points taken together strengthen the hypt 
thesis that fusion is established retinally. To test thi 
hypothesis further, additional physiological evident 
is required. Measurements of attenuation and dela 
under steady-state flicker stimulation at various point 
in the same visual system would be most helpful. Th 
low-pass filter action which has been observed coul 
arise from a number of mechanisms which act slowl 
and cannot follow high frequencies, e.g., phot 
chemical reactions, ion diffusion and depletion sy 
tems, and synaptic and dendritic conduction processe 
Precise knowledge of both attenuation and delay 
required in order to discriminate between differe’ 
possible models of the fusion mechanism. 

The rectifying property of the neuromime (include 
as a general function prior to these experiments, b 
required also by Enrotu’s data) was found to | 
essential for deriving the two-component flicker ? 
sults. We have noted that the two-component flick 
data obtained from the model were only qualitative! 
similar to those obtained psychophysically. Two it 
portant discrepancies should be noted. First, t 
response of the model was sharper. Second, it W 
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ioned that the precise positional matching of 
mse peaks was accidental. This became apparent 
. further psychophysical experiments were con- 
od using frequencies different from those reported 
The results for 20 and 40 c/s revealed a sensi- 
y peak at about 65°. For the model this peak 
d appear at 165°. 
hus the two-component flicker method provides 
itical test of the model. It lends qualitative 
ort, but discloses a quantitative inaccuracy in 
e characteristics. Note that the 
e error of 100° at 40 c/s corresponds 


sss than 7 msec. error in latency, input 

e total latency in the system is on 

order of 50 msec. This small dis- fi/fer __ 
ancy would be reduced in a model /®S/9756 
ng delay independent of frequency. 

t is difficult to conceive of a single- 

ent receptor system in which attenu- 

1 depends on frequency but delay 

not. Summation from anensemble spi pomime 
etinal elements having an appro- output 


distribution of delays could pro- 
such response. It is well established 
with few exceptions there is not a 
o-one anatomical or physiological 
munication between photoreceptor 
ganglion cell. A parallel filter, 
senting a number of laterally in- 
mnected retinal units, is presently 


s investigated. 


input 


ELMER sex 

Appendix response 

. Circuit details of the model. The 

it from which all experimental re- 

; were obtained is shown in Fig. 11. 

it signals are filtered by five indepen- . 

RC stages. Each stage is isolated N lb 
2 i aA put 

2 unity-gain amplifier (A, to A,). 

measured cutoff frequency f, of the 

plete filter is 10.0 c/s. 

‘he measured. attenuation-frequency 

acteristic is given in Fig. 12. 

Jote that this curve is reflected 

ly in the “fusion” data derived from 

neuromime as plotted in the points 

ig. 5. Delay characteristics of the 

r will be discussed below. 

‘he output of the final amplifier (A, in Fig. 11) 

ides the excitation for the ganglion cell analog 

hed enclosure). The purpose of the diode and the 

1etwork to ground is to provide an input waveform 

he neuromime which produces a rate of firing that 

off, i.e., adaptation. (This is an alternative method 


Fig. 13. 


hat described by Harmon, 1961). This circuit — 


ides some additional filtering, but its principal 
t is to distort the sine waveform. There is negli- 
effect on the critical flicker frequency as is 
snced by the above noted agreement between the 
- attenuation characteristic (Fig. 12) and the 
n data (Fig. 5). The introduction of this circuit 
s the average value of the excitation from its 
nal value of zero volts; the capacitative input 
uF) to the neuromime restores the zero average. 
. The composite nature of delay. It will be con- 
snt to consider delayed response both in terms of 
e lag and of latency. By phase lag we mean the 


Square wave__ 


Square wave__ 


number of degrees delay per cycle. By latency we 
mean the corresponding delay expressed in units of 
time. 

The total delay between stimulus and response 
comprises two independent components. Delay in the 
filter is the predominant one and is independent of 
input amplitude. The filter action is illustrated in 
Fig. 13. 

The upper section of A illustrates the response for 
a 10 c/s square-wave input. Filter response waveforms 
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B. /5c/s, 20 msec/ Div. 


A—At the top, square-wave input and responses measured at each of the five 
successive filter stages for 10 c/s input frequency. At the bottom, neuromime firing response 
to the filter output. B—Similar measurements for 15 c/s input frequency. As frequency is 
increased, amplitude of filter output becomes smaller, and spike frequency and number 


are diminished 


were taken at each of the five filter stages. As the 
signal progresses through the filter, its amplitude 
diminishes and phase lag increases until, after five 
stages (smallest:sine wave), the attenuation is 0.75 log 
units, and the phase lag is almost 220°. The responsive 
firing of the neuromime, shown in the lower trace, 
occurs after a total lag of slightly over 220°. At 10 c/s 
this corresponds to a latency of 61 msec. The response 
is a burst of 14 spikes lasting for approximately 
50 msec. 

At 15 c/s (Fig. 13, B) attenuation and phase lag are 
increased. The filter output now is a fundamental- 
frequency sinusoid which is approximately 1.25 log 
units below the unfiltered amplitude and which lags 
by about 300°, nearly one full cycle. The neuromime 
response is a burst of only four spikes lasting for 
21 msec, which is considerably less than half a period. 

The second component of delay is present but is not 
readily apparent in Fig. 13. It is due to the fact that 
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the excitation takes some time to reach the neuro- 
mimes non-zero threshold. This may be seen by 
referring to Fig. 141. The filter phase lag, shown as ®, 
is defined as the interval between stimulus off and the 
resultant zero crossing of the sinusoid. The additional 
lag from that point to threshold crossing is shown as 9. 


Wik eer al es eel cles, 


Schematized representation of the composite nature of delay. 


Fig. 14. 
Top—square-wave input. Center—sinusoidal filter output. Bottom— 
neuromime spike output. Filter phase lag ® makes maximum contribution 
to delay. The other component @ is due to the nonzero neuromime thresh- 
old. Off-latency is determined by ® + 9; inhibition-latency is 
determined by ®—O 


Both @ and @ are expressed in degrees so as to put 
them on a per cycle basis. For increased stimulus 
amplitudes ® will remain constant but @ will diminish. 
For decreased stimulus frequency both ® and @ will 
diminish. The total phase lag from stimulus off to 
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Fig. 15. Phase lag between stimulus and response is a function of two 
variables. ®—Theoretical lag due to low-pass filter action. @—Theoretical 


lag due to interaction of half-sine wave with neuromime threshold. ® + @— 
Total phase lag. Points show measured values 


neuromime firing is @®4+ 0, Similarly the interval 
from stimulus on to cessation of response is O—@, 

The variations of ® and @ with stimulus frequency 
are shown in Fig. 15. The middle curve (®) results 


hp Distortion of the excitation waveform to obtain adap- 
tation is ignored here for simplicity of analysis. The small 
effect of the distortion on delay may be seen in the experi- 
mental results (Fig. 7). : . 
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from the action of the 5-stage filter. It follows 
relationship 


@=5 cos [1+ (ffo)?)* 
where f and f, are the inputfrequency and the fil 
cutoff frequency respectively. The expression is 1 
relationship holding for a filter consisting of five 
dependent RC stages. a 

The lower curve (Q) represents the additional p 
lag due to the changing amplitude of the filter out] 
as frequency is varied. It would be zero for an infi 
tely large output. The delay reaches a maximu 
90° when the filter output is just equal to the ne 
mime’s threshold. By Enroru’s definition this is” 
fusion condition. This value of maximum delay 
consistent with Enrorn’s observation that at fus 
the difference between off-latency and inhibiti 
latency is equal to the stimulus half period. Expres 
as phase lag, 


(D+ 0) — (® — 0) = 180° 


and so 
OOO, 
Theoretical values of 9 may be derived from | 
0 =sin! V/E 


where E is the peak amplitude of the half sinus 
(filter output), and Vis the threshold. Since the atter 
ation characteristic of the filter can be expressed 


E/E; = (1 + (ff)? 1°", 

(where £; is the input amplitude to the filter), Eqs. 
and (3) can be combined to yield 4 
@ =sin™ [(V/E;) (1 + (f/fo)? P71. 

This is the expression satisfied by the lower curve 
Fig. 15. ; 
The composite, total delay ®+ @ is plotted at? 
top of the figure as the sum of the other two cury 
The points shown are experimental values obtai 
from the data in Fig. 6. These results are in reas 
ably good agreement with those of ENRoTH, in wh 
the phase lag varies monotonically from about 1908 
10 c/s (start of line 1, Fig. 2) to approximately 4 
at the 20c/s fusion point (arrow in line 3, Fig. 
The theoretical latencies discussed earlier { 
Fig. 7) were derived directly from the phase lags j 
described. For example, each value 7' of off-latet 
is obtained from 
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which is simply phase lag expressed in units of til 


We are indebted to C. Enroru, H. pe Lanex, Dan. 
D. H. Ketry for their stimulating and helpful correspondet 
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ummary. Hitherto it was assumed that the input signals 
arning matrix are digital, especially binary. In this paper 
roperties of learning matrices capable of learning and 
ssing accordingly patterns of non-digital nature are 
jigated. It is shown that the recognition of patterns by 
3 of such non-digital learning matrices offers extraordinary 
jilities for the formation of invariants. For the des- 
on of the learning process a formal “‘perceptor”’ is defined, 
roperties of which are characteristic of both organic and 
ological perceptors. In addition, it is shown how the 
ological realization of non-digital learning matrices can 
complished. 
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1. Problemstellung 


n einer fritheren Verdffentlichung (STEINBUCH 
) wurde ein Verfahren beschrieben, wie gewitinschte 
dnungen zwischen je einem endlichen Satz von 
ren ,,Higenschaften“ e; und eitier ,, Bedeutung“? b, 
in matrixformiges Schaltungssystem, die Lern- 
ix, eingelernt werden kénnen. Diese Lernmatrix 
glicht die korrekte Zuordnung der Bedeutung zu 
Satz bindrer Eigenschaften auch noch dann, wenn 
Storung dieses Eigenschaftssatzes vorliegt, solange 
Hammingabstand zum urspriinglichen Higen- 
'tssatz kleiner bleibt als der Abstand zu einem 
ren, einer Bedeutung zugeordneten Higenschafts- 


lieses Verhalten der Lernmatrix macht ihre Funk- 
unempfindlich gegeniiber nicht allzugroBen zu- 
en Stérungen des Informationsangebots, sofern 
Information redundant angeboten wird. Die 


Der Begriff ,,Bedeutung“ wird hier verwendet im Sinne 
durch Eigenschaften codierten, einheitlichen Gegeben- 
(Auf eine Diskussion des Zusammenhanges mit dem 
itungsbegriff der Linguistik und der Semantik wird 
htet.) 


weitergehende Aufgabe, die Ausgabe der Lernmatrix 
auch invariant gegeniiber systematischen Anderungen 
des Informationsangebots zu belassen, solange diese 
innerhalb einer vorgegebenen Klasse bleiben, kann 
unter Verwendung von (z.B. zylindrischen) Lern- 
matrizen gelést werden, deren Betrieb nicht eindeutig 
umkehrbar ist (FRANK 1961b), aber auch durch Ver- 
kettung oder Schichtung von Lernmatrizen. Diese 
Methode der Invariantenbildung ist jedoch etwas auf- 
wendig. 

In einer anderen Ver6ffentlichung (FRANK 1961a) 
wurde die Lernmatrix als Modell der Definition von 
,Perzeptoren zugrunde gelegt. Dabei sollte jedes 
System von ,,Beobachtungsoperatoren“, d.h. von 
Vorrichtungen, welche jeweils einen Objektweltzustand 
oder eine Klasse solcher Zustande (z.B. das Vorliegen 
eines Zeichens aus einer definierten Klasse) registrieren, 
Perzeptor genannt werden. Es wurde vorausgesetzt, 
dai die Menge der unterscheidbaren Zustande des 
beobachteten Systems (der Objektwelt) endlich und 
die Zustande selbst durch binaére Merkmale gekenn- 
zeichnet sind. 

Es liegt nun einerseits nahe, den mathematischen 
Perzeptor-Begriff auf kontinuierliche Merkmale zu 
verallgemeinern, und andererseits nach einer Realisie- 
rung der Lernmatrix zu suchen, welche stetig ver- 
anderliche Kigenschaftsgr6Ben zu verarbeiten vermag. 
Im folgenden Béitrag wird ein solcher Perzeptor zuerst 
als Operator mathematisch definiert und hernach seine 
nachrichtentechnische Realisierung dargestellt, deren 
Struktur der digitalen Lernmatrix entspricht. Dabei 
soll es sich zunachst um eine nichtdigitale Lernmatrix 
in der Kann-Phase handeln. (Hine nichtdigitale Lern- 
matrix verwendet Eingangssignale, welche nicht digi- 
tal sind.) Es wird gezeigt, daB sie sowohl gegen zu- 
fallige Stérungen unempfindlich als auch zur Bildung 
gewisser, vor allem affiner, Invarianten fahig ist. An. 
schlieBend wird ein Verfahren entwickelt, wie die 
gewiinschte Art der Zuordnung in das System ein- 
gelernt werden kann. AbschlieBend wird das allgemeine 
Problem angeschnitten, welche Forderungen an Per- 
zeptoren zu stellen sind, von denen gesagt werden 
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kann, daB sie das leisten, was in einem verallgemeiner- 
Ge erat is 1 
ten Sinne ,,Perzeption genannt werden kann’. 


2. Definition eines nichtdigitalen Perzeptors 
Wir sagen, ein System ,,lerne“, wenn es ein inneres 
Modell der AuRenwelt dieser AuBenwelt anpaBt (STEIN- 
pucH 1959a). Ein Perzeptor der im Rahmen dieser 


Merkimale 
a (y 


a) 


Vektor—- 
Aomponenten 


Py 


b) 


rh PPE Senos |S vf y 
Abb. 1. Merkmalfunktion und Vektorkomponenten 


Arbeit interessierenden Art mu also (als das beob- 
achtende System) einer AuBenwelt (als dem beob- 
achteten System) gegentibergestellt werden und ein 
inneres verainderbares Modell dieser beobachteten 
AuBenwelt enthalten. 


ae it 
Pr 
Abb. 2. Perzeptionsereignis P und Muster e; im dreidimensionalen 
Vektorraum 


Jedes Merkmal eines beobachteten Objekts (AuBen- 
weltzustandes) mége durch eine reelle Zahl y, 0<y<n 
(n eine natiirliche Zahl), gekennzeichnet werden. Bei- 
spielsweise kénnen die beobachteten Objekte Zeitfunk- 
tionen innerhalb des Zeitintervalls 0<t<n- At sein 
so da das durch die Zahl y bezeichnete Merkmal der 
Funktionswert an der Stelle ty - Atist. Es empfiehlt 
sich jedoch nicht, die Betrachtung auf diesen, wenn 

1 Diese Verallgemeinerung wurde in einer Arbeit ,, Uber 
einen abstrakten Perzeptionsbegriff von Frank ausfiihrlicher 
dargestellt. und erschien wirhend der Drucklegung des gegen- 


wiirtigen Beitrags in Band 2, Heft 3, der ,,Grundlagenstudien 
aus Kybernetik und Geisteswissenschaft‘, 
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auch vielleicht praktisch wichtigsten, Sonderfall, 
auf Zeitfunktionen, einzuschranken. 

Jedes Merkmal kann verschiedenen beobacht 
Objekten in verschiedenem Grade zukommen, und 2 
moge es sich um eine kontinuierliche Gradsk 
handeln. Zu jedem Objekt und jedem Merkma 
moge also eine reelle Zahl a, existieren, welche angi 
daB das Objekt dieses Merkmal mit dem Grad 
besitzt. (a, kann beispielsweise die Frequenz des ¢ 
sten, a, die des mittleren und a, die des héchsten Te 
eines Dreiklangs sein.) Das Objekt kann daher 
reelle Funktion a(v) im Intervall 0<»<7n defini 
werden (Abb. la). 

Wir suchen nun einen Perzeptor P, der an 
Punkten vy =1, 2,...., » des Definitionsbereichs y 
a(v) die Funktionswerte 4,d:,....,4, Von 
ermittelt und die zwischenliegenden Funktionswe 
unberiicksichtigt 1a8t. P ist also ein Operator, der 
Funktion a(yv) auf einen 2-dimensionalen Vektor ¢ 
bildet, oder allgemein: den Objektraum aller méglick 
Funktionen (dessen Koordinatenmenge die Macht 
keit des linearen Kontinuums hat) auf den n-dimer 
nalen Vektorraum. Waren beispielsweise die b 
achteten Objekte Zeitfunktionen, dann identifizie 
alle jene Zeitfunktionen miteinander, welche an alle 
Abtaststellen gleiche Funktionswerte haben. : 

Wir denken uns P aus n Teiloperatoren zusamm 
gesetzt, die wir Receptoren nennen. Der Recep 
Nummer y ermittelt den Funktionswert a, der Fu 
tion a(v) an der Stelle y, liefert also die y-te Parti 
information p, tiber die Abbildung des Objekts 
auf einen Vektor, d.h. die y-te Komponente di 
Vektors. Die Ausgabewerte p,,....,p, der Ree 
toren bilden ihrerseits einen Vektor p, welcher 
proportional verschliisselnden Receptoren mit d 
Vektor (a,,..,qa,) numerisch tibereinstimmen k: 
jedoch sind auch nichtlineare Abbildungen des Obj 
raums auf den n-dimensionalen Vektorraum de 
denkbar. Jede Abbildung eines durch eine Merk 
funktion a(y) gekennzeichneten Objekts auf ei 
Vektor p,d.h. jede Registrierung der n Funktio 
werte von a(yv) durch die Receptoren von P, nent 
wir ein Perzeptionsereignis ». Das Perzeptionserei 
ist definiert durch die n Ausgabewerte der Recepto 
(Abb. 1b). 

Im Falle einer Abtastung an nur n =3 Stellen 1 
positiven Merkmalfunktionen a(y) kann man sich | 
Raum der méglichen Perzeptionsereignisse p, + 
stellen als ersten Oktanten des dreidimensiona 
cartesischen Koordinatensystems von Abb. 2. 1! 
fordern nun, dafs der Perzeptor a 

1. alle Perzeptionsereignisse miteinander ide 
fiziert (d.h. zum selben Ausgabewert verarbei 
welche sich nur im Betrag |p| nicht aber im Wi 
zu den Koordinatenachsen des n-dimensionalen | 
torraums unterscheiden und — 

2. unempfindlich gegen geringe Schwankun 
dieses Winkels ist. Ss 
: Dies lauft darauf hinaus, den Oktanden in Ab 
in Sektoren unterzuteilen, so daB alle im selben Sek 
liegende Vektoren miteinander identifiziert werd 
Die Sektoren bestimmen also Klassen b; von Vekte 
Dabei sieht man jedoch, daB die Grenzen zwist 
diesen Sektoren, z.B. in einer vorausgehenden L 
phase, festgelegt sein miuissen, bevor ein Perzepti 
ereignis zu einem Ausgabewert verarbeitet wet 


a: 
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n. Das heiBt, die Klassen miissen definiert sein, 
or die Vektoren in sie eingeordnet werden kénnen. 
Diese vorzugebenden Klassen sind nun gerade das 
nere Modell‘ der AuBenwelt, das im Perzeptor P 
oeichert sein mu. Genauer: in P muB ein (end- 
es) Repertoire der zu erwartenden Perzeptions- 
gnisse vorhanden sein, so daB jedes eintretende Per- 
tionsereignis als Realisierung des nachstahnlichen 
arteten gewertet wird. Die erwarteten Perzep- 
isereignisse kénnen der mathematischen Einfach- 
) halber m verschiedene Einheitsvektoren ¢, sein, 
en in der AuBenwelt die ,,Muster‘ entsprechen. 
erwarteten Perzeptionsereignisse bestimmen so- 
agen ,,Perzeptionsformen‘‘, in welche jede auf- 
ommene Information eingeordnet wird, ,,einrastet‘‘. 
se erwarteten Perzeptionsereignisse ¢,, ¢),..., Cin 
1 genauer gesagt gespeichert als Perzeptionsformen q;. 
logisch saubere Trennung zwischen abgetasteten 
rkmalen a@,,...,a,, dadurch gewonnenen Partial- 
rmationen p,..., p, als Verschliisselungen dieser 
tkmale und zugleich als Komponenten des Per- 
tionsereignisses p, und schlieBlich den Komponenten 
+++,9;, Ger Perzeptionsform g; als des inneren 
peicherten Modells gewisser, durch die Muster be- 
kter, Perzeptionsereignisse einheitlicher GréBe ¢,, 
nt sich, da alle diese GréBen auch in der Realisie- 
g zu unterscheiden sind. Nur in Spezialfallen, 
m namlich die einzelnen Abbildungsvorginge 
portionale Verschliisselungen darstellen, besteht 
nerisch kein wesentlicher Unterschied zwischen den 
ind den p, bzw. zwischen den e; und den q;. 
Die Forderung (1) ist nun dadurch zu erfiillen, daB 
es Perzeptionsereignis der Form » =c - e; unabhan- 
von dem positiven Faktor ¢ (der Lange des Vek- 
sp) zur selben Ausgabe ftihrt. Der Forderung (2) 
nen wir dadurch nachkommen, da ein Perzep- 
asereignis ) mit demjenigen erwarteten Hreignis ¢; 
ntifiziert wird, mit dem es das gréBte innere Vek- 
produkt »-e; bildet. (Im Perzeptor selbst liegt e; 
uirlich nur in der gespeicherten Form q,; vor, so daB 
sichlich das Vektorprodukt »-g,; gebildet wird.) 
rch die e; werden damit die gewiinschten Sektoren 
Raum der p erzeugt, deren Schnittlinien mit der 
iheitskugel in Abb. 2 eingezeichnet sind. Man kann 
liesem dreidimensionalen Falle also sehen, daB z. B. 
eingezeichnete Vektor ) in die durch e, gebildete 
wsse fallt. Man kann also die bisherigen Uberlegun- 
. zusammenfassend so beschreiben : 
Das innere Modell von P besteht aus m Perzep- 
asformen g;, welche Klassen méglicher Perzeptions- 
ignisse p bilden. Die p selbst sind Verschliisselungen 
‘durch die Merkmale a(v) bestimmten, beobachteten 
stinde bzw. Objekte der Auf enwelt durch die 
septoren von P. In jede Klasse b; fallt genau eines 
-erwarteten Perzeptionsereignisse e;. Dabei gehdrt 
ar Klasse 6,,, falls fiir alle 7 gilt pe; <pe, (und damit 
Die inneren Produkte J;=-g,; sind noch vom 
rag des Perzeptionsereignisses abhangig, jedoch 
‘den alle J, mit derselben positiven Zahl c multi- 
jiert, sobald » mit diesem Faktor multipliziert wird, 
. aber, daB der Index, welcher das maximale innere 
dukt kennzeichnet, derselbe bleibt — obwohl sich 
; dem Betrag von p auch die GroBe des Maximums 
lerte. Die Organe des Perzeptors P miissen daher 
ammenfassend sein 


1. Receptoren, welche die Merkmalfunktion a(y) an 
n Stellen » abtasten und durch die Komponenten 7, 
von ) verschliisseln. 

2.m Vektoren q;, welche als gespeicherte Perzep- 
tionsformen dem Repertoire der erwarteten Perzep- 
tionsereignisse e; einheitlichen Betrags entsprechen 
und damit das innere Modell der AuBenwelt ausmachen. 

3. Eine Vorrichtung, welche fiir jedes Perzeptions- 
ereignis die inneren Produkte J;=)-g; mit der ge- 
speicherten Form gq, bildet. 

4, Kine Vorrichtung, welche bestimmt, zu welchem 
Index ¢ das maximale innere Produkt J; gehort 
(Extremwertbestimmung) und demgemaB als Aus- 
gabeinformation des Perzeptors mitteilt, dai das beob- 
achtete Objekt in die entsprechende Klasse 5, fallt. 


Se NF 
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Abb. 3. Mégliche Invariantenbildungen 


(Die Ausgabe kann also als System von m binéren Beob- 
achtungsoperatoren b; aufgefaht werden, von denen 
jeder mitteilt, ob das Objekt in die von ihm beobachtete 
Klasse fallt oder nicht.) 

Uberlegt man schlieBlich, was in Abb. 1b geandert 
werden kann, ohne dafsi ein anderer Beobachtungs- 
operator von P anspricht, dann ist es 

1. die Multiplikation aller Ordinatenwerte p, mit 
derselben positiven Zahl c, also eine affine Transforma- 
tion der p,; 

2. die Uberlagerung einer Stérung nicht zu groker 
Effektivwerts, die also im Mittel die Verhaltnisse 
zwischen den einzelnen Ordinatenwerten (d.h. in 
Abb. 2 den Winkel von » mit den Koordinatenachsen) 
nicht zu stark verandert. 

Man beachte, da8 der Perzeptor P genau dann eine 
(storungsunempfindliche) Invariantenbildung gegen- 
tiber affinen Transformationen von a(y) mit der »-Achse 
als Affinitatsachse leistet, wenn die Verschliisselungen 
p, der a, durch die Receptoren proportional zu den a, 
sind. Andere Verschliisselungen gestatten andere 
Invariantenbildungen. Beispielsweise kann p, pro- 
portional zur 1. Ableitung a’(v) bzw. zum ersten 
Differenzenquotienten, also zu a,—a,., sein; dann ist 
die Aussage des Perzeptors invariant gegen Trans- 
lationen der Merkmalfunktion in Ordinatenrichtung 
und zugleich gegen affine Transformationen. Bei pro- 
portionaler Verschliisselung der 2. Ableitung a’’(v) 
ergibt sich zusatzlich Scherungsinvarianz, usw. (vgl. 
Abb. 3). Natiirlich miissen dabei auch die gespeicher- 
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ten Perzeptionsformen g; dem Differential- oder 
Differenzenquotienten der Merkmalfunktion entspre- 
chen. Andere Invariantenbildungen ergeben sich durch 
geeignete nicht-linear arbeitende Perzeptoren, | d.h. 
mathematisch durch geeignet zu wahlende Funktionen 


Pp, =f (4,)- 


Abb. 5. Darstellung des Produkts © - p’ = b 


3. Realisierung 
Der Perzeptor P als System von m Beobachtungs- 
operatoren 6; kann leicht durch ein nachrichtentech- 
nisches Modell realisiert werden, z.B. wenn dafiir 
gesorgt wird, dab die vorzuschaltenden Abtastrecep- 


Abb. 6. Photographie des Modells der nichtdigitalen Lernmatrix 


toren die a, durch Spannungswerte w, verschliisseln, daB 
also p, =u, ist. Das innere Produkt I; =u-9, wird 
dann durch Leitwerte g;,, gema® der Schaltung in 
Abb. 4 realisiert. Um gleichzeitig alle inneren Pro- 
dukte J; zu erhalten, geniigt es, m solche Zeilen parallel 
zu schalten (Abb. 5). Eine abschlieBende Schaltung 
(vgl. den folgenden Abschnitt) ermittelt die Zeile mit 
dem gr6Bten inneren Produkt (d.h. also der gré8ten 
Stromstirke) /; und bewirkt demgemaB eine Anzeige 
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Ausgainge. 
Eine Demonstrationsmodell der hier beschrieben 
Art (n=5 Hingangswerte, m=5 Beobachtung 
operatoren) zeigt Abb. 6. 
Anwendungsbeispiel erwahnten wir eingan 
die Erkennung von Zeitfunktionen. Soll eine Zeit 
funktion s(t) durch die Receptoren des beschriebene 
Perzeptors abgetastet und verschliisselt werden, danj 
mu sie zunadchst in eine Raumfunktion a(v) umge 
wandelt werden. Dies ist durch eine reflexionsfre 
abgeschlossene Laufzeitkette der in Abb. 7 angedeu 
teten Art méglich. Die umgekehrte Aufgabe, Raum 
funktionen durch eine derartige Kette in Zeitfunk 
tionen zu verwandeln ist ebenfalls unter Verwendun; 
von Laufzeitketten méglich, interessiert im Rahmei 
vorliegender Untersuchung jedoch nicht. 


a (tip SeR a Coe ay wee an 
Abb. 7. Umwandlung durch Laufzeitkette 


4. Verfahren der Extremwertbestimmung 
Als wesentliches Bauelement bei der nachrichtet 
technischen Realisierung des zunachst nur abstrakt 
mathematisch beschriebenen Perzeptors erwies si¢ 
eine Schaltung zur Extremwertbestimmung erfordel 
lich, wie sie auch bei der friiher beschriebenen, digit 
arbeitenden Lernmatrix bendtigt und dort anhan 
einer einfachen Realisierung beschrieben wurde (STED 
BUCH 1961). . 


bestimmung. In allen drei Fallen wird die Aufgak 
gelést, denjenigen Zweig zu bestimmen, an welché 


Indicator kann man sich beispielsweise ein elektr 
magnetisches Relais vorstellen, welches bei einé 
gewissen Mindeststrom fiir den zugehdrigen Zwe 
anspricht, und dabei die Aussage liefert, da® an diese 
Zweig maximale Erregung J; auftrat. é 


5. Beriicksichtigung negativer Merkmale — 


Die Merkmalfunktion a(y) war in Abb. la & 
iiberall positiv gezeichnet worden, obgleich wir bei d 
fhathematischen Gedankenfithrung in § 2 von dies 
Eigenschaft nirgends Gebrauch machten. Auch 
der Realisierung in §3 war diese Einschrankung U 
wesentlich, da zur proportionalen Verschliisselui 
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tiver a, negative Spannungswerte u, zur Verfiigung 
en. Die einzige Schwierigkeit ergibt sich, wenn 
| fiir die gespeicherte Perzeptionsform g, negative 
yponenten zugelassen sind (wenn also in Abb. 2 
e; nicht mehr alle im ersten Oktanten liegen!), 
1 diese negativen Komponenten lassen sich nicht 
r in einfacher Weise realisieren. 
strebt man dennoch ein passives Netzwerk an, 
1 mu} man zu erreichen suchen, daB das y-te 
tastete Merkmal genau dann den Strom J,erhoht, 
n es im Vorzeichen mit der y-ten Komponenten 
e; (bzw. q;) tbereinstimmt. Dies kann durch 
pelte, kontrare Kingabe von u, in Doppelspalten 
tt der einfachen Spalten, die in Abb. 5 gezeichnet 
in Abb. 6 realisiert wurden) geleistet werden, und 
r so, daf} die Spannung + |w,| am ersten, — | w,| 
zweiten der kontraren EKingange anliegt, falls 
0, und umgekehrt, falls a,<0 ist. Die Kompo- 
ie g;, der gespeicherten Perzeptionsform g, wird 


n realisiert durch den Leitwert g; , zur ersten Spalte ~ 


den Leitwert 0 zur zweiten, falls die Vektor- 
iponente positiv ist, jedoch durch den Leitwert 0 
ersten und —g,, zur zweiten, falls g,;, negativ ist. 
s dann die Vorzeichen von u, und g,, tiberein- 
men, wirkt sich nur die positive Spannungsein- 
> aus, d.h. es entsteht ein positiver Strombeitrag 
, zul;, andernfalls wirkt sich im selben Sinn nur die 
itive Komponente aus. Das in diesem Sinne 
inzte Schaltschema zeigt Abb. 9. 
Damit ist der oben allgemein definierte Perzeptor 
leicher Allgemeinheit realisiert durch eine Matrix- 
ktur, welche sich als Generalisierung der in der 
rten friheren Arbeit beschriebenen Lernmatrix 
eine Schaltung gleicher Struktur aber mit nicht 
wendig digitalen Eingangssignalen erweist, wobei 
rdings zunachst nur die Kann-Phase beriicksichtigt 


6. Die Lernphase 


Hs entsteht nun die Aufgabe, die Komponenten g ;, 
eingespeicherten Perzeptionsformen (welche das 
ertoire der erwarteten Perzeptionsereignisse aus- 
shen) nicht fest vorzugeben, sondern in einer voraus- 
enden Lernphase dadurch in das System einzu- 
en, da den Receptoren gewisse a(v) als Muster 
segeben und zugleich ein Signal auf jeweils den- 
gen Ausgang b; gegeben wird, der in der Kannphase 
Identifikation des erneut vorgelegten Musters bzw. 
s zur selben Klasse gehérigen Objekts mit dem 
yeicherten Bild des Musters anzeigen soll. Dabei 
den die g;, zweckmaBigerweise nicht durch Leit- 
te, sondern durch elektromagnetische GréBen 
isiert. 
Das hier vorgeschlagene Verfahren besteht darin, 
die GréGBen g;, einer beliebigen eingespercherten 
zeptionsform festgestellt und mit den betreffen- 
Komponenten der in eben diese Zeile eonzulernen- 
Perzeptionsform verglichen werden. Aus der 
erenz beider Betrage wird eine GroBe abgeleitet, 
the die g,, nur dieser Zeile derart beeinfluft, dab die 
erenz beider Betrage kleiner wird und sich schlieB- 
dem Wert Null nahert. 
Dieses Verhalten ist mit dem eines Regelkreises 
jleichbar. Die GréBe des angebotenen, also ein- 
rnenden Merkmals entspricht dem Sollwert, die 
Be des g;, dem Istwert, und die Differenz beider 
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der Regelgro®e. Hieraus wird eine StellgréBe abgelei- 
tet, welche g;, so veraindert, daB die RegelgréBe ein 
Minimum und im Idealfall Null, g;, also proportional 
dem einzulernenden e,, wird. 
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Abb. 8. Schaltungen zur Extrembestimmung 


Das Verfahren sei an Hand von Abb. 10 erlautert. 
Als Komponenten g;, werden ferromagnetische An- 
ordnungen, z.B. Ferritkerne oder Bandkerne verwendet. 

Die Komponente e;,, der zu lernenden Perzeptions- 
form werden durch Gleichspannungen a;, reprasen- 
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Abb. 9. Invarianz gegeniiber affinen Transformationen 


tiert. Dies entspricht der Sollwerteingabe bei einem 
Regelkreis. Durch SchlieBen des Schalters B; wird 
der LernprozeB einer Perzeptionsform in die i-te Zeile 
vorbereitet, unter Mitwirkung des Lese- und Schreib- 
generators. Nach SchlieBen des Schalters B, flieBt 
in der i-ten Zeile ein hochfrequenter Wechselstrom, 
dessen Amplitude und dessen Frequenz so zu wahlen 
sind, da8 der Induktionszustand der Ringkerne nicht 
geandert wird. Der hochfrequente Wechselstrom 
induziert in den Spaltendrahten 2 eine Wechsel- 
spannung U, die infolge der nichtlinearen Kennlinie 
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der Ringkerne einen Spannungsanteil der doppelten 
Frequenz des erregenden Wechselstromes enthalt 
(2. Oberwelle). Die Amplituden und die Phasen dieser 
Oberwellenspannungen hangen vom magnetischen Zu- 
stand der Ringkerne ab, der zunachst beliebig sei. In 
den Leseverstarkern L.V. werden die Oberwellen- 
spannungen phasenrichtig demoduliert und in zu 
ihnen proportionale Gleichspannungen a,,, umgeformt, 
die als Istwert ebenso wie die Sollwerte a;, einer Ver- 
gleichsschaltung V.S. zugefiihrt werden. In dieser 
wird der Istwert a;, mit dem Sollwert a;, verglichen 
und ein Differenzstrom S, abgeleitet, der aus einem 
Anteil S;,, hervorgerufen durch die dem Merkmal 
a;, zugeordnete Spannung, und einem Anteil S;,’, 
erzeugt durch die (aus der vom magnetischen Zustand 
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des Ringkerns abhangigen Oberwellenspannung ab- 
geleitete) Spannung a,;,’ besteht, und der Differenz 
beider Spannungen proportional ist: 

S, =8;,—8;,' =const x (a;, —aj, ) 
S,, sei der Strom, der den magnetischen Zustand eines 
Ringkerns gerade zu andern vermag. Dann ist zu 
fordern, daB 

So< en 

bleibt, damit in sémtlichen iibrigen Ringkernen der 
betreffenden Spalte, die nicht der ausgewahlten 7-ten 
Zeile zugehoren, der Induktionszustand unverandert 
bleibt. 

Ebenso bestand auch die Forderung, daB die Am- 
plitude des hochfrequenten Wechselstromes so klein 
ist, daB der Wechselstrom allein den Induktions- 
zustand des Ringkerns nicht beeinflussen kann. Erst 
durch das Zusammenwirken des Differenzstromes und 
des Hochfrequenzstromes, wird in den Ringkernen 
lings der durch SchlieBen des Schalters B; ausgewahl- 
ten Zeile der Induktionszustand verandert, und zwar 
so, daB die Abweichung der dem magnetischen Zu- 
stand der Kerne entsprechenden Gleichspannungen 
a;, von den, den einzulernenden Merkmalen adaqua- 
ten Gleichspannungen a; , verringert wird und sich dem 
Werte Null nahert. Wird die Abweichung Null, so 
wird auch der Differenzstrom S, zu Null, und zufolge 
der vorher geforderten Bedingung fiir die Amplitude 
des Wechselstromes kann keine weitere Beeinflussung 
des Induktionszustandes der Ringkerne eintreten, 
Dies bedeutet aber: Werden in einer nachfolgenden 
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Kannphase die Ringkerne der 7-ten Zeile abgefragt, s 
induziert jeder Ringkern in einer Abfragewicklung 
welche in der Kannphase durch den Zeilendraht das 
gestellt ist, eine Ausgangsspannung, deren 2. Oberwell 
nach phasenrichtiger Demodulation und Gleichrichtun 
gerade derjenigen Gleichspannung entspricht, welch 
die betreffende Komponente der zuvor gelernte 
Perzeptionsform reprasentiert. — Die technisch 
Realisierbarkeit dieses Verfahrens, das einen erste 
Entwurf darstellt, wird z. Z. an unserem Instit 


untersucht. 


7. Weitere Méglichkeiten 


Die Merkmalfunktion a(v) ist als eindeutige F 
tion vorausgesetzt worden. Bei fliichtiger Betrachtun 
des in § 2 Gesagten kénnte dies als starke Kinschra 
kung empfunden werden. Denn affine Transform 
tionen werden in der Geometrie vor allem auch a 
mehrdeutige Funktionen, wie Ellipsen, Hyperbelr 
Trapeze usw. angewandt. An dieser Stelle zeigt sic 
nun der Vorteil der oben versuchten, méglichst sorg 
faltigen begrifflichen Unterscheidung. a(y) sollte kein 
als Objekt betrachtete Funktion sondern eine Funktio 
sein, welche angibt, in welchem Grade das willkirli¢ 
durch die reelle Zahl » gekennzeichnete Merkms 
einem betrachteten Objekt zuakommt. Nur in Spezia 
fallen, z. B. wenn Zeitfunktionen als Objekte fungierer 
fallt a(v) praktisch mit dem beobachteten Objekt 2 
sammen. 

Jede praktisch vorkommende Figur  (Ellipsé 
Schriftzeichen usw.) la&t sich als endlich-vieldeutig 
Funktion auffassen, und fede endlich-vieldeutig 
Funktion laBt sich in eine endliche Anzahl von Zweige 
zerlegen, die ihrerseits eindeutige Funktionen sind un 


lichen Zahl nicht geandert. Man kénnte beispielsweis 
die z Zweige als Fortsetzungen des ersten Zwei 
definieren und damit den Definitionsbereich v« 
O0<y<n auf 0<»<zn erweitern (Abb. 11b) und he 


zeichnen, durch die reellen Zahlen »/z ersetzen (A 
bildung 11c). Der Definitionsbereich aller z Zwei 


handene Kurvenstiicke, in denen zwei Zweige tbe 
einstimmen, erscheinen doppelt (vgl. Abb. lla m 
1b). Natiirlich ist auch jede beliebige Vertauschun 
in der Ordnung der Merkmale méglich. Das Wesen 
liche ist, daB fiir alle Zweige derselbe Affinitatsfal 
tor c relevant ist, wie es ja bei der affinen Abbildur 
einer Figur im Sinne der Geometrie der Fall ist. 
Abtastung einer solchen Figur kann (ZusammengesetZ 
heit aus nur zwei Zweigen vorausgesetzt) beispiel 
weise dadurch erfolgen, daB an allen Stellen « =2yd 
zweidimensionalen Objekts der kleinste und der groB 
Abszissenabstand der Figur ermittelt wird (Abb. 11: 
wobei dieser das Merkmal a(n/2 +), jener das Mer 
mal a(v) liefert (Abb. 11e). ; 

Durch dieses Prinzip ist auch das in § 2 erwihn 
Problem der Erkennung eines Akkords als einer dre 
deutigen, konstanten Funktion der Zeit lésbar (ut 
allgemeiner: die Identifikation eines mehrstimmigt 
musikalischen Themas, das gegentiber dem eingeler 
ten Muster in eine andere Tonart transponiert wuré 
d.h. dessen Frequenzen alle mit demselben Fakt 


— 
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tipliziert sind). Als Ordinatenwerte fungieren hier 
Frequenzen, als Abszissenwerte die Zeit, so daB in 
selben Weise wie in Abb. 11 eine endlich-vieldeutige 
uktion durch eine geeignete Verkniipfung der 
eporn in eine eindeutige Funktion transformiert 
Da die Extremwertbestimmung die Information 
r den Effektivwert c des Perzeptionsereignisses 
-¢- e; unterdriickt, ist ihre Funktion nicht eindeu- 
umkehrbar. Der Umkehrbetrieb fiihrt, falls die 
nktion der Receptoren eindeutig umkehrbar ist, 
Erstellung der Muster, deren inneres Modell die 
peicherten Perzeptionsformen sind. 
Die in den Erregungshéhen J; der Beobachtungs- 
ratoren 6; liegende, durch die Extremwertbestim- 
ng unterdriickte Information ist aber mit erheb- 
ler Redundanz behaftet, falls die vorgesehenen 
ster, d.h. die ,,Perzeptionsformen‘‘ bekannt sind. 
Falle der binéren Lernmatrix in der Kannphase 
rde dies naher untersucht und wird demnachst in 
er Publikation von ZeNpnH dargestellt. Habe eine 
che ,,Bedeutungsmatrix’’ m—=2” Beobachtungs- 
sratoren, dann existieren fiir jedes J; n +1 még- 
1e Stromstarken von 0 bis n. Von den (n +1) @” 
schiedenen Kombinationen von J; sind aber nur 
e geringe Zahl méglich. Denn wenn bekannt ist, 
3 b; anspricht, dann ist bekannt, daB I; die Strom- 
rke n hat. AuBerdem sind alle p, und damit alle 
leren Stromstirken bekannt. Tatsachlich kommen 
o nur 2” verschiedene Vektoren § =(1,,...,,,) von 
1 (n+1)@” méglichen vor, daher die Redundanz 
; Vektors 9. E 
Hs ist darum moglich, das Perzeptionsereignis 
sh dann zu identifizieren, wenn der zugehdérige 
obachtungsoperator (und sogar zusatzlich noch 
Jere), ausfallt, aber die Stromstarken der restlichen 
obachtungsoperatoren bekannt sind. Wie diese 
ntifikation durch eine Matrixschaltung geleistet 
rden kann, wird in der Veroffentlichung von ZEN- 
H behandelt werden. Man sieht durch Verall- 
neinerung der eben skizzierten Betrachtungen, da 
che ,,selbstkorrigierenden Schaltungen“, also Ma- 
xschaltungen, die auch dann noch richtige Aussagen 
ern, wenn wesentliche Teile von ihnen ausfallen 
ar sonstige Fehlfunktionen liefern, auch fiir nicht- 
itale Lernmatrizen existieren miissen. 
AbschlieBend sei noch auf die mathematische Seite 
; Problems hingewiesen. Die gewahlte Abbildung 
- Abtastwerte auf einen Vektor im n-dimensionalen 
um entspricht dem Vorgehen von SHANNON (1949), 
‘statt mit Vektoren mit Punkten arbeitet und dabei 
seinen bekannten Aussagen tiber die Kanalkapazitat 
_Anwesenheit von weifem Rauschen kommt. Es 
tt nahe, von diesen Gedankengangen ausgehend 
e quantitative Theorie der Speicherkapazitaét der 
htbinaren Lernmatrix und eine die Kannphase 
reffende Theorie des maximalen Verkntipfungs- 
sktes als nicht-digitale Verallgemeinerung des in 
er friiheren Arbeit (SterinBucH 1959b) Gesagten 
entwickeln. Untersuchungen dariiber sind noch im 
nge. 


8. Perzeptoren und Perzeption 
Der hier von einer friiheren Arbeit (FRANK 1961a) 
rnommene Begriff des Perzeptors mag tiberraschen, 
er auf die Biologie oder Psychologie zu verweisen 
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scheint. Es gehért aber zum Wesen der Kybernetik, 
gewisse Begriffe einzelner Wissenschaften von un- 
wesentlichen, nur diese Wissenschaft selbst interessie- 
renden Bestimmungsstiicken zu losen, und sie dadurch 
so zu verallgemeinern, daf ihre Relevanz fiir eine ganze 


(zwe/dimensionales) 


Qbjekt 


Merkmaltunktion 
a (Y” 


Abb. 11. 


Erzeugung von @ (v) 


Klasse von Wissenschaften deutlich wird. In diesem 
Sinne versteht A. A. Moues (1960) unter Organismen 
nicht allein das, was der Biologe darunter versteht, 
sondern jedes geniigend komplexe, auch technische 
oder gesellschaftliche System, das mehrere Freiheits- 
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Abb. 12. Die beiden Phasen des Wahrnehmungsprozesses (schematisch) 


grade der Funktion aufweist, und er definiert dem- 
entsprechend Kybernetik als die Wissenschaft vonden 
Organismen ohne Riicksicht auf die Besonderheiten 
der diese konstituierenden Organe. 

Man kann sich fragen, ob nicht auch der Begriff der 
Perzeption, der als erste Phase des Wahrnehmungs- 
prozesses der anschliefenden Phase der (bewuBten) 
Apperzeption gegeniibergestellt wird (FRANK 1961b) 
von unwesentlichen Besonderheiten, z.B. dem Vor- 
handensein einer Netzhaut oder der Basilarmembran 
samt Haarzellen, gelost werden kann, und welches die 
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verbleibenden wesentlichen Bestimmungsstiicke dieses 
Begriffes sind. 

Fiinf Sachverhalte scheinen dabei wesentlich und 
zur Definition eines allgemeinen, abstrakten Perzep- 
tionsbegriffes ausreichend zu sein (Abb. 12): 

1. Die perzipierten AuBenweltobjekte konnen mehr 
Merkmale haben, als durch die Receptoren registriert 
werden kénnen (fiir den Menschen z.B. magnetische 
Eigenschaften), d.h. es wird bei der Perzeption nur ein 
Teil der in der Merkmalfunktion steckenden Informa- 
tion abgetastet. 

| 2. Die durch die Receptoren verschliisselte Informa- 
tion kann grofer sein, als die als Ausgabe des perzi- 
pierenden Systems der anschlieBenden Apperzeption 
verfiigbar gemachten Information. (Dies kann z.B. 
darauf beruhen, daB verschiedene Receptoren tiber 
dieselben Kanale — Nervenfasern — ableiten, vgl. 
Abb. 12!) 

3. Als Ausgabe erscheint nicht eine Fille zusammen- 
hangloser Einzeldaten, vielmehr die Hinheit des identi- 
fizierten Objekts, z.B. durch Einordnung in fest vor- 
gegebene oder eingelernte Perzeptionsformen (z.B. 
.,Gesicht statt der beim Fernsehen nacheinander 
iibertragenen und nebeneinander gestellten Teilmerk- 
male). 

4. Verschiedene solcher Einheiten werden durch 
Invariantenbildung zu Klassen zusammengefaBt. 


The transfer function of a photoreceptor organ* 
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Summary. The dynamic response of a simple ganglionic 
photoreceptor has been studied. It exemplifies the general 
processes of sensory reception and transmission of sensory 
information in the form of trains of nerve impulses. The 
experimental basis of the defining linear transfer function is 
presented. This transfer function is composed of a second order 
lag and a transport delay. The ventral nerve cord conduction 
time does not contribute to the transport delay. Nonlinear 
discrepancies from the linear model are evaluated and discussed. 


Introduction 


A full description of the function of a sensory organ 
or sensory element should include definition of the 
limits of signal transfer. This can be done if the 
stimulating energy is monitored, and at the same time, 
the nervous impulses emanating from the sensory 
receptor are detected and studied. It is believed that 
the signal which represents the input stimulus, and 
which is transmitted to other centers of the central 
nervous system, is the average frequency of these nerve 
impulses. By correlating the instantaneous values 
of the stimulus and the nerve impulse signal, it is 
possible to make a rigorous statement regarding the 
transfer characteristics of the sensory receptor. The 
task, then, is to find the equation (generally an integro- 
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5. Der (psychologisch und philosophisch schwer ; 
fassende) Bewuftseinsbegriff ist fiir die Perzeptic 
nicht relevant, im Gegensatz zur anschlieBenden Pha 
der Apperzeption, welche in der bewuBten Zuwendur 
der Aufmerksamkeit zu Teilen der vermoge der Pe 
zeption verfiigbaren Information und ihrer bewubt 
Verkniipfung mit Gedachtnisinhalten besteht. 

Nennt man einen Organismus (im allgemeing 
Sinne von Mors), der einen ProzeB der Perzeption - 
diesem obigen Sinne leistet, einen Perzeptor, dar 
erhalt man einen Begriff, der das deckt, was in §2a 
Perzeptor eingefiihrt wurde. Insbesondere verm: 
auch die nichtdigitale Lernmatrix die Funktion d 
Perzeption in diesem verallgemeinerten, kybernet 
sehen Wortsinn zu erfiillen und darf daher zurecht a 
Perzeptor bezeichnet werden. ; 
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differential equation) which characterizes the function: 
relationship between input and output [1—4]. 


Method 

Photoreceptor. To explore the problem, we hay 
chosen to study the photosensitive tail ganglion ¢ 
Cambarus astacus, the common crayfish [5 
Behavioral and reflex studies have demonstrated 
physiological role for the receptor [9,] [10]. 

Fig 1 shows a photograph of the neuroanatomic¢ 
structure. The terminal abdominal ganglion, a 2 mi 
diameter translucent neuropil, receives fibers ¢ 
several sensory modes from the uropods [11], [12 
A small number (circa 10) of neurones transdu 
photic energy. Lack of optical apparatus, absence ¢ 
apparent spatial arrays in its structure, and sluggish 
ness of behavioral response, suggest that the ganglio 
serves to detect average levels of background ill 
mination. 

Through a window in the ventral abdominal ex 
skeleton, gross electrodes were applied to the ventri 
nerve cord. The animal was kept in a humidity an 
temperature controlled environment (100 per cel 
saturation, 19+ 0.59 C). Maintenance of adequa 
blood pressure and minimization of blood loss prove 
to be critical in the preparation. The crayfish y 
fixed by two bands of rubber to a corkboard 
Supine position. Chelipeds were sheathed in rubb 
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tubing pinned to the board. The hydrostatic 
level of the tail ganglion was approximated to 
a level several millimeters above the ventral 
coelom. Steady state recording of at least six 
hours was possible. 

Apparatus. An electronically controlled light 
source was used to generate transient steps as 
well as sinusoidal variations of light. The light 
source contained a monitoring phototcell whose 
output could be recorded during an experiment 
[13]. The light was focused to an approximately 
z mm? spot falling on the photosensitive ab- 
dominal ganglion. The light stimulus was cali- 
brated by means of an illuminometer. The 
ventral nerve cord and the other abdominal 
ganglia gave no response when illuminated. 

Signals were led off by gross platinum 
electrodes to conventional A. C. amplifiers. The 
electrodes were hooked about the ventral ab- 
dominal cord in varying positions along the 
chain of ganglia. Visual monitoring of nerve 
impulses was not detectably altered by shifts 
in location of the gross platinum hook electrodes ; 
obviously change in cross-sectional location of a 
given light fiber produced very little change 
in potential. Correlation of pulse velocity and 
pulse height supported the visual impression ; 
pulses of the same height (but from different 
fibers) showed equal velocities wherever recorded 
in the cord [14]. One could also anticipate the 
small variation of recorded pulse height despite 
spatial shift of recording electrode from cal- 


. 1. 6th abdominal ganglion of the crayfish, Cambarus astacus. The ganglion culations of estimated extracellular impedance 


sists of a layer of primary and secondary neurones embedded in a dense neuropil. pathways [15]. The population of light sensitive 

2 photosensitive cells are not distinguishable by current histologic techniques. 3 

[hey number on the order of ten. (Photograph courtesy af BRAITENBERG 
and IIDA) 
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3. 2a andb. Pulse seletion and pulse shaping. a The top trace shows the 
nerve-impulse train. The bottom trace shows the shaped pulses (1 msec. 
Its) triggered at a selected level of the nerve impulse which may be 
er positive or negative with regard to the base line as desired, b The 
e pulse selection and pulse shaping may be seen at greater magnification. 
width of the standard pulse was set at 0.5 or 1.0 msec so as to allow for 
y averaging but still separate trigger pulses close together in time 


neurones showed a homogeneous pulse height 
(and, of course, velocity) distribution. 
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Figs. 3aandb. Nerve impulse response to light. a An example of the pulse 
rate with relatively low illumination. Note the large (“‘A’’), medium-sized 
(“B”), and small (“‘C’’) nerve impulses. b The pulse rate increases greatly 
when illumination is increased. Note that this increase is due to “B” 
nerve impulses alone 
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Advantage was taken of pulse height constancy to 
screen out those pulses whose heights were greater or 
less than the pulses carrying the light signals [16]. 
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group “A” (> 125 uv) was uncorrelated. The “C 
group was screened out by raising the bias level. 
taking the difference of the 
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Fig. 4. Response of photosensitive ganglion to a step change of light. Shows the response 
of the photoganglion in terms of average frequency of nerve impulses from B fibers, to 
a step of light flux. The noise seen comes, in part from random groupings of nerve impulse 
from different fibers. The solid line represents the response of the linear model system 
described by the transfer function discussed below. The lack of fit is explained by two 
factors. First, random variations in a single step function are considerable. Second, the 
small signal approximation is violated in step experiments and certain nonlinearities 

produce divergences 


Individual pulses whose height was greater than a 
preselected level triggered a standard pulse, as may be 
seen in Fig.2. The pulse height groups could be 
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Fig. 5. Transient experiment. Fig. 5 shows the lack of contribution of nerve conduction 
processes in the photosensitive 
Conduction velocity is approximately 4 m/sec. 
ails of the response are preserved over the 18 mm conduction 
glia, This step of light was a rather large, violating completely 
ation analysis. Damping is inversely proportional to forcing 


time to the non-minimum phase element (time delay). Thus, 
ganglion are responsible for this operator. 
It is interesting to note that det: 
path, through three abdominal gai 

the theory of small perturb 


function amplitude 


separated into three crude divisions. A midrange 
group “B” (75—125 uv) carried the light signal: a 
low voltage group “C” (35—50 pv) correlated inversely 
with the light fiber activity; and a high voltage 


the ventral nerve cord. The stimulus is record 
as the calibrated output of the monitoring photoce 
A sudden change in level of illumination produces 


absence of synaptic relays with the attend x 


: 
Kybernet 


c 


‘A” group from th 
remaining “A” and “B” group, a “B 
window could be formed. Our results wer 
confirmed using a conventional pulse heigh 
discrimination counter [16]. The effect: « 
illuminating the ganglion may be seen 1 
Fig. 3. 

The standard pulses were passed throug 
a low pass filter whose time consta 
(0.24 sec) was long with respect to the ol 


repetition rate, but short with respect to th 
response frequency of the photorecepto: 
The output of the low pass filter (an analo 
voltage whose level corresponds to ft 
instantaneous output frequency of t 
neurone population) was displayed on 
standard penwriter. 4 


Experimental Section 


Transient Inputs. The response of t 
photosensitive ganglion is measured i 
terms of the average frequency of firi 
of the population of “B” nerve fibers 


response: rapidly increased firing 
of the nerve fiber population. Fig. 
shows such an experiment. The 
sponse exhibits some characteristi 
dynamic features: long latent peri 
inflected rise to maximum with b 
overshoot or ringing, and mainta: 
DC response. These features will | 
measured and examined in detail } 
means of the experiments describ 
below. The irregularity of the ba 
line consists of high frequency f 
tuations and low frequency dr 
Irregular grouping of the variou 
nerve fiber impulse trains is probabl 
the cause of much of this variation a: 
may conveniently be treated as nois 


The time delay could be due 
nerve conduction time or to process 
in the photosensitive ganglion. 17 
pairs of electrodes monitoring 1 
nerve impulse response were locate 
at either end of the abdominal venti 
nerve cord as illustrated in Fig. 
The response from each electrode: 
exhibits a long latent period of e 
duration. Calculation of the né 
conduction velocity indicates whi 
this experiment proves, namely thi 
conduction time (5 milliseconds) 
negligible compared to the la 
period (1 sec). It is of interest to 


b, 


vs 
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In this experiment, rather more overshoot is 
arent as the input signal was intentionally made 
her large (by dark adapting the photosensitive 
glion). 
Sinusoidal Inputs. In order to quantify carefully 
dynamic characteristics of the photoganglion 
ve impulse response, we resorted to sinusoidal 
uts. By this means we were able to subject the 
tem to a steady state analysis. After initial con- 
on transients have died out, at a single frequency, 
response is related to the input by two parameters 
y: gain (relative amplitude of input and output), 
| phase shift (amount of lag of response after stimu- 
. Since such a canonical description applies only to 
ar systems, we attempted to approach linear 
rating conditions by using small stimulating signals 
ut a steady “DC” light level!. Further, noise and 
e variations in responsiveness of the ganglion were 
uimized by averaging responses over a number of 
les. Harmonic distortions, although present, did 
contribute much power compared to the funda- 
ntal response. A set of such experiments are shown 
Fig. 6. 
Analysis. The dynamic behavior of the photo- 
sitive ganglion was studied by means of frequency 
ponse experiments. This series was so devised as to 
ninate trends. The driving frequencies were 
domly ordered inside of each sequence and the 
uences repeated. No sequence coincided in order 
irequency presentation, but each sequence spanned 
entire spectrum. 
The gain and phase parameters averaged within 
h run are plotted in Fig. 7. From this Bode plot 
> can obtain several quantitative measures of the 
2amics of the system. The low frequency gain is 
pulses per second per millilumen. The break 
quency, clearly shown by means of asymptotes 
wn to fit the experimental curve, was found to be 
0.2 cycles per second. Above this frequency the 
ponse attentuates with a minus two slope (12 de- 
els/octave, 40 db/decade or 20 decilog/decade). At 
break frequency, the gain is down 6 decibels or 
lecilog from the low frequency value. The phase 
a show a great deal of phase lag near the low 
yuency, high gain response region. This will be 
n to be due to a large non-minimum phase element. 
The phase curve represents a theoretical compo- 
curve whose elements can be seen clearly in Fig. 8. 


Here, the phase contribution of the minimum 
ise elements (computed from the minus two slope 
| the break frequency) is added to a phase lag 
duced by a deduced non-minimum phase element 
sport delay or latent period of 1 sec). The com- 
ite phase curve adequately fits the experimental 
a. 
Having obtained the above quantitative measure- 
ats from the Bode Plot we may construct a transfer 
ction, in terms of the Laplace transform complex 
iable “‘s’’. 
32 e-1.08 


i(s) = T+ 129 pulses sec? millilumen™ (1) 


| The important parameter to minimize in order to achieve 
wization is the degree of modulation with respect to the 
level of light and not the absolute amplitude of the input 
soidal function. 
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where 32 is the low frequency gain, e~1.° represents the 
non-minimum phase element or delay time, and 
(1+ 1.28)? defines the second order critically damped 
lagging elements which attenuate the high frequency 
response. 
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Fig. 6. Response of a photoreceptor to sinusoidal light changes. Note that 
harmonic distortion is minimized by small signal approach. The 0.03 cps 
input produces an output with amplitude of + 70 pps, a mean of 130 pps, 
and a phase lag of 22°. The 0.10 eps input shows an output amplitude of 
+50 pps and amean of 146 pps. The 0.30 cps input shows an output ampli- 
tude of +40 pulses per second and a mean of 154 pulse per second. The 
monotonic but not regular increase of the mean may be related to system 
nonlinearities which distort the response shape 


A less convenient form is the classical integro- 
differential equation 


+P (2) 


39 L (f—-1) =1.44 


where L=light flux in millilumens; P= pulses per 
seconds; t=time in seconds. 

The polar plot of gain as a function of phase lag 
provides another graphic display of system dynamics. 
Frequency is a monotonically increasing, but not 
regularly increasing function in the clockwise direc- 
tion. The non-minimum phase element, the time delay, 
spirals the curve about zero with a phase lag pro- 
portional to frequency. The lack of adaptation is 
clearly demonstrated by the absence both of phase 
advance and low frequency attenuation in the range 
studied (see Fig. 9). 

Step Analyses. From the transfer function one 
can construct the theoretical response of the linear 
system to a step change of light. This computed 
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response is shown in Fig. 4 as the dashed line super- 
imposed (for comparison) upon the experimentally 
found response. The differences are striking and 
outside the limits of experimental error. The com- 
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Fig. 7. Bode plot. Gain is plotted on a log-log scale, phase lag on linear-log 

scale. The points are experimental, The continuous line of the gain plot 

is guided by the asymptotes on either side of the break frequency. The 

response is down 6 decibels at the break frequency of 0.2 cps which is 

characteristic of a second order system. The phase lag curve is 

computed from the sum of the minimum and non-minimum phase 
elements (Fig. 8) 
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Fig. 8. Bode plot. Decomposition of phase elements. The composite curve 
CPE is computed from the joint contributions of the non-minimum phase 
elements (NMPE) and minimum phase elements (MPE). The MPE (lag 
elements) are computed from the experimentally obtained equation of the 
1 
"G12 The NMPE is due to transport delay 
(1.0 sec) and represents the element which when added to the MPH, pro- 
duces a good approximation to the experimental data. Note that no phase 
advance appears in the frequency range studied. The points are experimental 


second order system — 


puted response has been obtained by linearized (small 
signal) approximation to the real system. 

The step experiments in Figs. 4 and 5 clearly violate 
the small signal approach utilized in the frequency 
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response studies. The discrepancies are due to nor 
linearities which become significant in the (large signa 
step experiments. These will be reported in a folloy 


ing study. 


- 270° 


/requency 
/ncreasing 


0° 


JO 100 150 200 


Gain (pulses sec mu ') 


Note: 


numbers: in repres 
° — 9° the average of that n 
Mame a Phase shift PUNS. 


Fig. 9. Polar plot of the transfer function. Polar plot representation 
relation of gain to phase of output versus input. The solid line is comput 
from the actual curves of gain and phase lag in the Bode diagram (Fig. 
Note the absence of phase advance. Frequency increases monotonically t 
not regularly in a clockwise direction. Phase lag increases due to a consta 
delay (non-minimum) element. The gain decreases as the phase lag increa: 
at higher frequencies. Phase lag and gain combine to account for the spi 
in toward zero ’ 


Discussion 


Several interesting features of the crayfish phot 
sensitive ganglion response should be stressed. First 
it is a population response; and although much of tl 
noise (not at all germane to the biological system) is’ 
contributed, certain other experimental advantag 
accrue, namely, an averaging of response over sho 
and long periods of time. PRINGLE and WILSO 
working with a cockroach proprioceptor, were ak 
to obtain only inconsistent data: steps and thr 
frequency points [1]. The crayfish ganglion was al 
advantageous in having a maintained DC respons 


and a frequency response slow with respect to the pul 
repetition rate. | 


The slow dynamics and the long latent peri 
suggest that the ganglion photoresponse drives a to1 
reflex; and indeed this isso. The random walk respor 
is a low priority response which shows itself only if. 
more active behavior is called for. Then, high lig 
level produces a photokinetic random walk into 
region of subdued illumination [10]. 4 


, The small signal requirement for linear approxin 
tion only partly eliminated persistent nonlineariti 
asymmetrical response, DC level dependence on drivi 
frequency, harmonic distortion. When a large sign 
as in the step experiments of Figs. 4 and 5, is employ 
departures from linearity can be marked. The lin 
response predicted from the transfer function shot 
be symmetrical about the inflection point, and 1 
ically damped, without overshoot or ringing. 
certain amplitude ranges, an inverse relations! 
holds between damping and input amplitude. Des 
these observed deviations from linearity, the exp 
mental analysis above has succeeded in defining / 
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stem dynamics with considerable validity. The 
»pulation averaging, the stationarity of the prepara- 
on, the fact that the frequency response range is 
uch slower than the pulse repetition rate, and of 
yurse the biological factors involved in careful 
aintenance of the preparation have all contributed 
» the success of the approach. Perhaps the most 
gnificant part of the approach is the use of small 
gnal sinusoidal inputs. Here the linear character- 
tics of the system can be extracted with minimum 
terference from nonlinearities. The ability to average 
rer many cycles and tens of seconds of response 
creased the precision of the experimental measure- 
ents. 
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Buchbesprechungen 


hlitt, Herbert: Systemtheorie fiir regellose Vorgiinge. Stati- 
ische Verfahren fiir die Nachrichten- und Regelungstechnik. 
rlin-Géttingen-Heidelberg: Springer 1960. XI, 3448., 
7 Abb. u. 1 Taf. Geb. DM 49.50. 

Es war sicherlich keine leichte Aufgabe, das in den letzten 
Jahren angesammelte Material aus dem Gebiet der stati- 
ischen Verfahren in Nachrichten- und Regelungstechnik im 
uhmen eines nicht zu umfangreichen Buches zusammenzu- 
ssen. In der deutschsprachigen Fachliteratur fehlte schon 
it Jahren ein geeignetes Werk, das sich mit der Anwendung 
utistischer Methoden bei der Behandlung nachrichteniiber- 
vgender und -verarbeitender Systeme befaBt. — Die beiden 
sten Kapitel enthalten die Elemente der mathematischen 
atistik, behandelt unter dem Gesichtspunkt der physikalisch- 
shnischen Anwendungen. Auf dieser Basis baut sich die Be- 
beitung des gesamten Stoffes auf. Der Reihe nach werden 
handelt: Die linearen Systeme (Kapitel III), die zeit- 
hangigen regellosen Vorginge und deren statistische Kenn- 
sBen, die Korrelationsfunktionen und Leistungsspektren 
apitel IV), die Zusammenhange zwischen den Kenngrofen 
n Kingangs- und Ausgangssignalen bei linearen Systemen 
_ Zeit- und Frequenzbereich (Kapitel V). Im _ sechsten 
upitel werden die bekanntesten linearen Filter im einzelnen 
sprochen. SchlieBlich werden 2 Verfahren zur Lésung 
shtlinearer Probleme sowie die Synthese von Optimal- 
ern dargestellt (Kapitel VII und VIII). — Bei der Einteilung 
3 Stoffes behielt der Verfasser die didaktischen Gesichts- 
nkte eines Lehrbuches im Auge. Um innere Zusammen- 
nge herauszuarbeiten, greift er nach Hinfiihrung neuer Be- 


griffe durchweg auf vorhergehende Abschnitte zuriick. So 
wird z.B. nach Behandlung der Korrelationsfunktionen 
(im Kapitel IV) ein kurzer Abschnitt den Zusammenhingen 
zwischen Korrelationskoeffizienten (Kapitel II) und Korrela- 
tionsfunktionen gewidmet. — Besonders hervorzuheben ist 
das Bemiihen des Verfassers, Begriffe — die leicht zu Un- 
klarheiten und zum Uberschreiten der Anwendungsméglichkeit 
fiihren — bis in die letzten Einzelheiten klar darzustellen, die 
Bedeutung an praktischen Beispielen zu erlautern und den Be- 
reich der Anwendungsméglichkeit abzugrenzen. Es sei an 
dieser Stelle der Abschnitt iiber den Korrelationskoeffizienten 
und seine Bedeutung hinsichtlich der funktionalen Abhangig- 
keit zweier statistischer GréBen, sowie das umfangreiche 
Unterkapitel tiber die Kigenschaften des Einheitsimpulses er- 
wahnt. — Der Stoff des Buches stellt eine Verbindung zwi- 
schen verschiedenen Forschungsrichtungen dar. Dement- 
sprechend sucht der Verfasser seine Nomenklatur der des 
Schrifttums der Nachbargebiete anzupassen. — Als Leserkreis 
fiir sein Buch werden vom Verfasser ,, Ingenieure und Physiker, 
sowie Studierende aus dem Bereich der Nachrichtenverarbei- 
tung, der Informationstheorie, der Nachrichten- und Regelungs- 
technik“ genannt. Beim Leser werden ,,solide Grundkennt- 
nisse in der Infinitesimalrechnung, der Funktionentheorie sowie 
in der Elektrotechnik“ vorausgesetzt. — Vergleicht man das 
vorliegende Werk mit zur Zeit vorhandenen fremdsprachigen 
(insbesondere amerikanischen und englischen) Biichern, so 
darf behauptet werden, daB es durch Stoffauswahl und Aufbau 
zu den modernsten auf diesem Gebiet gezahlt werden kann. 
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1. Manuskript. Es soll einseitig mit Schreibmaschine, mit einem mindestens 4 om breiten Rand und ausreichendem Zeilen- 
and (etwa 30 Zeilen pro Seite) geschrieben sein. Soweit Teile des Manuskriptes in einem kleineren Schriftgrad (Petit) gesetzt 
den kénnen, sind sie durch einen vertikalen Strich am Rande unter Beifiigung des Buchstabens ,,p“ zu kennzeichnen. Formeln, 
noten und Tabellen werden automatisch in Petit gesetzt. Tabellen sind mit Uberschriften zu versehen und laufend zu numerieren. 


Jedem Beitrag soll eine Zusammenfassung beigegeben werden. Fiir deutsche Arbeiten sind Zusammenfassungen in englischer, fiir 
ische Arbeiten in deutscher Sprache erwiinscht. 


Der Umfang der Beitriige soll so knapp wie méglich gehalten werden. 


2. Literatur. Die Literaturhinweise im laufenden Text erfolgen durch Nennung des bzw. der Autorennamen, wenn es sich um einen 
r zwei Autoren handelt. Bei mehr als zwei Autoren wird nur der erste genannt, gefolgt von dem Zusatz ,,et al.‘‘. Werden mehr 
eine Arbeit desselben Autors oder derselben Autorengruppe zitiert, so ist hinter dem Namen das Erscheinungsjahr der Arbeit 


ugeben. Stammen mehrere Arbeiten desselben Autors aus dem gleichen Jahr, werden die Buchstaben a, b, c usw. der Jahreszahl 
wugefiigt, z.B. Murmr (1958 a). 


Im Literaturverzeichnis sind die zitierten Arbeiten ohne Numerierung in alphabetischer Reihenfolge nach dem Namen des 
eils ersten Autors (bzw. bei mehreren Arbeiten des gleichen Autors nach Jahreszahl und gef. a, b, c usw.) anzordnen. 


Zeitschriftenaufsaitze werden zitiert mit Namen und Initialen aller Autoren, vollstindigem Titel der Arbeit in der Original- 


che, Titel der Zeitschrift (in der international tiblichen Abkiirzung), Bandnummer (bitte unterstreichen), Seitenzahl sowie in 
mmern gesetzter Jahreszahl. 


Biicher werden zitiert mit Namen und Initialen des oder der Autoren, vollstindigem Titel, Auflage, Erscheinungsort, Verlag 
| Erscheinungsjahr. 


3. Illustrationen. Strenge Auswahl der Abbildungen ist erwiinscht. 


Fiir schematische Strichbilder geniigt die Ablieferung deutlicher Skizzen, die vom Verlag umgezeichnet werden. Fiir Halbton- 
ler, von denen Autotypien hergestellt werden miissen, sind scharfe Originalphotographien in Hochglanzabziigen oder Original- 
hnungen erforderlich. Die Reproduktion nach bereits gerasterten Drucken ist zu vermeiden. 


Sollen eine Photographie oder andere Abbildungsvorlage Hinweislinien oder Beschriftung erhalten, so ist dies mit weichem 
istift auf einem Deckblatt oder auf einem zweiten Abzug anzugeben. Die Endpunkte der Hinweislinien sind jeweils mit einem 
en Nadelstich zu markieren. Hinweislinien und Beschriftung werden dann vom Verlag auf die Vorlage iibertragen. 


Photographien sollen in méglichst groSem Format eingereicht werden. Wiinsche der Autoren beziiglich des Verkleinerungs- 
Bstabes sind bereits auf der Vorlage anzugeben, damit bei erforderlicher Beschriftung darauf Riicksicht genommen werden kann. 
Seitenrichtigkeit der Vorlagen ist vor Ablieferung an den Verlag zu priifen und erforderlichenfalls genau zu bezeichnen. 


Alle Abbildungen sind mit Unterschriften zu versehen, die auf besonderen Blattern (nicht auf den Vorlagen) erbeten werden. 
xildungsvorlagen und Legenden sollen nicht in den Text eingefiigt, sondern fiir sich geordnet werden. 


Bei Ubernahme von Abbildungen aus anderen Werken wird um genaue Quellenangabe gebeten. 


Instructions for the Preparation of Manuscripts 


1. Form of Manuscript. The Manuscript should be typewritten, using only one side of the paper, and should have wide margins 
’=4cem) and be double spaced (ca. 30 lines to the page). Those sections of the manuscript that may be printed in smaller 
tit) type are to be indicated by a vertical line in the margin with the letter “P’’. Formulae, footnotes, tables and legends will 
ays be printed in petit. Tables should be provided with a caption and numbered consecutively. 


Each manuscript should be accompanied by a summary. Papers written in German should be summarized in English and vice 
3a. ‘ 


Papers should be as short as possible. Py 


2. References. References should be cited in the text by the author’s name and the year of publication. When there are more 
n two authors only the first is named and the words “et al.” are added. If only one paper by a given author is cited the year 
ublication may be omitted in the text. When more than one paper with the same author and year of publication is cited’ the 
ers are differentiated by a small letter following the year, e.g. MErEeR (1958a). 


Papers cited should appear in the Bibliography unnumbered, in alphabetical order by Author and year of publication. For 
ers published in periodicals give the names and initials of all authors, the full title of the paper in the original language, the title 
he periodical in the standard international abbreviation, the volume number underlined, the page numbers, and the year of 
lication in brackets. For Books give the names and initials of the author, the full title, the edition, the places of publication, 
publisher, and the year of publication. 


3. Figures and Tables. Figures should be carefully selected. For schematic drawings dear sketches suffice; they will be redrawn 
the publisher. For illustrations requiring half tone reproduction either clear original photographs on glossy paper or original 
wings must be supplied. Avoid prints already having a screen across. If an illustration is to be provided with aITOws Or lettering 
y should be drawn on the cover or a duplicate with a soft pencil. The points of the arrows should be indicated by a fine pin 
k. The arrows and lettering will be carried out by the publishers. Photographs should be as large as possible. Any special wishes 
he author about the size of the reproduction should be noted on the cover or duplicate, so that if lettering is required this can 
aken into account. The orientation of the figures should be checked, and if necessary distinctly marked, before sending them to 
publishers. All figures must be furnished with a legend. This should be written on a separate sheet, not on the photograph or 
wing. Figures and legends should not be embodied in the text but arranged separately. 


[t is requested that illustrations taken from other publications be accompanied by full information as to their source. 


Die Herausgeber Springer-Verlag 


Harmon, L. D., Studies with Artificial Neurons, I: Pro- 
perties and Functions of an Artificial Neuron. With 
21 Figures in the Text 

BercewK, W. A. vAN, Studies with feats Neurons, 

II: Analog of the External Spiral Innervation of the 
Cochlea. With 10 Figures in the Text ...- - 102 
Levinson, J., and L. D. Harmony, Studies with Artificial Buchbesprechungen 
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The Ninth International eee a Linguists, under the | ; 
presidency of Ervar HavceEn, will be held in Cambridge, Mas- “ 
sachusetts, at Harvard University and at the Massachusetts 
Institute of Technology, from August 27 to. August 31, 1962. 
The Congress will have five Plenary Sessions, twelve Section | 
Meetings, and an as yet undetermined number of Group Meet-— 
ings. The topics and rapporteurs for the et Sessions are: 
“On the Methods of Internal Reconstruction’ ais ‘Kuryo- 
wicz; “Levels of Linguistic Analysis’, E. ‘Bunvenisre. 
tural Variation in Language,” A. Martryer; “The 
Basis of Linguistic Theory”, N. Cuomsxy; and ; 
Aspects of Translation® (rapporteur invited). 
Meetings, which will consist of four contribt { 


matical Linguistics, Phonetics na PE 
Geography, Bey Heino mse: and pone 


rie vives, Fy ae aaa 
and Society. Contributed | papers * that. cannot 


ment of the Plan. are- ae to: 
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